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Lecture 1 
Introduction 



1.1 Origins of my teaching this course 

I have taught Math 32 many times since I came to Brandeis in 1960 — in fact probably 
as often as everyone else in the department combined. But this time it is going to be 
somewhat different and I want to tell you a little about how I happen to be teaching it 

again seven years after I became emeritus. 

I became interested in mathematical visualization (using computer graphics) about a 
dozen years ago, and I have been working on a program called 3D-XplorMath that dis- 
plays a large number of mathematical objects and processes ever since. In fact I retired 
from teaching earlier than I otherwise might have in order to have more time to think 
about Mathematical Visualization and continue development of the program. If you are a 
Mac user and would like to try out 3D-XplorMath, it is available from my web-site: 

http:/ /rsp. math.brandeis.edu/3D-XplorMath/TopLevel/download. html 
or from VersionTr acker. 

The program should be thought of as a Mathematical Museum. Although it wasn't 
originally designed as a teaching tool many people started using it as an adjunct to their 
instruction and wrote back to me encouraging me to add more features for that purpose. 
So about two years ago I applied for an NSF CCLI grant for funding to turn 3DXM into a 
curriculum enhancement tool. I am the Principle Investigator on the grant and about six 
other mathematicians from all over the world (The 3DXM Consortium) are working with 
me on it. 

As part of the grant activity we proposed to develop curricula for courses in ODE and 
differential geometry, using 3DXM to enhance the teaching in those subjects, and to give 
some courses in these subjects to test the new curricula. We gave the first of those pilot 
courses last winter in Taiwan to a class of about this size. It was a "crash course" that 
met six hours a week for six weeks and I was part of a team of five who participated in 
the instruction. 

I think that we were all very surprised at how well the course went and at the enthusiasm 
of the students for the way it was taught. In the end we all felt that the success of the 
course came not just from using 3DXM to help the students visualize the concepts of the 
course, but even more from another learning technique that we stressed. Namely we had 
the students form into teams, tht worked together to write their own software to implement 
the theoretical material of the course algorithmically. In fact I was so impressed by the 
students enthusiasm that I asked to teach Math 32a this Fall and use the same approach. 

What does it mean to "implement the theoretical material of the course algorithmically" ? 
That may sound like just fancy jargon, but I have something very real and specific in mind 
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and since it will play an important role in the way this course is taught, I want to try to 
explain it to you now — or at least start. 

Mathematical theorems are often described as being either constructive or non-construct- 
ive. What exactly is the difference? Let me illustrate with two very famous theorems, 

Banach Contraction Principle. If X is a closed subset of R" and F : X — > X sat- 
isfies ll-F(ic) — F{y)\\ < K \\x — y\\ for all x,y ^ X with K < 1 then there is a unique 
point p of X such that F{p) = p, and moreover for any point x of X the sequence 
F{x), F{F{x)), F{F{F{x))), . . . converges to p. 

Brouwer Fixed Point Theorem. If D s the unit disk in the plane and F is any con- 
tinuous map of D into itself, then there is a point p of D such that F{p) — p. 

These two theorems may appear superficially similar in that both assert the existence 
of point p left fixed by a particular kind of map. However, while in the first case the proof 
(and the very statement of the theorem) give an algorithm for finding p, in the second case 
there is no such algorithm. Instead the proof is by contradiction — it shows that if there 
were no such p, then it would be possible to continuously map the disk onto its boundary 
by a map leaving each point of the boundary fixed, and this is known to be impossible. 

> 1.1 — Exercise 1. Let X = [0, 1] and define F : X ^ X hy F{x) = cos(a;). Use the 
Mean Value Theorem to prove that F satisfies the hypothesis of the Banach Contraction 
Principle, and use a hand calculator to estimate the fixed point of F to two decimal places. 



1.2 Algorithmic Mathematics 

By doing mathematics algorithmically I mean using a computer and some programming 
system to actually "create" mathematical objects from constructive proofs of their exis- 
tence. But what does it really mean to construct some desired mathematical object on a 
computer? 

1) First one has to define data structures that describe the mathematical object one is trying 
to create and also the other objects that arise in the existence proof. (For example, a 
point in the plane is described by a pair (x,y) of floating point numbers, and a triangle 

is described by three such pairs.) 

2) Then one has to translate the mathematical algorithms for constructing the mathemtat- 
ical object into subroutines in the programming system that act on the given data 
sructures to construct a data structure describing the desired object. 

3) Finally, one has to write graphical procedures to display the data describing the created 
object in a meaningful way. 

If one has to start from scratch, using a standard low-level programming system like 
Pascal, or C or Java, this can be a very difficult task and time-consuming task. But 
fortunately there are several excellent "high-level" mathematical programming systems 
that have already done much of the work of defining good mathematical data structures 
and writing important functions and subroutines that act on these data structures as well 
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as easy to use routines for displaying these mathematical data structures visually. Perhaps 
the three most popular are Matlab, Mathematica and Maple. 

Mathematica and Maple are fairly similar. Both were designed to work primarily with 
symbolic expressions, so they are particularly suited for doing algebra and simplifying com- 
plicated expressions. Matlab is primarily a system for doing numerical analysis. Its basic 
data structures are vectors and matrices, so it excels in problems that involve numerical 
linear algebra. And all three have good visualization "back-ends" for displaying the results 
of computation. 

It turns out that Matlab 's strong points make it particularly well-suited to carrying out 
the sort of projects we will encounter in this course. 

In the Taiwan course, we used both Mathematica and Matlab, and students were able 
to carry out the projects with both, but our experience was that it was easier to teach the 
sudents Matlab and the students found it easier to work with. However, if some of you 
already know Mathematica (or Maple) and would likem to use it to do the projects, that 
is fine with me. 

What are the main programming projects I have in mind. Three of the central theorems 
in curve and surface theory have very beautiful construcive proofs. When I taught these 
theorems before I never stressed their constructive nature. But in fact actually translating 
these theorems into code is quite feasible even for programming beginners, and doing so 
will not only make the meaning of the theorems and the proofs much clearer for you, but 
also it will be an excellent way for you to become expert in Matlab, a skill that you should 
find very useful in the years ahead. 



1.3 What next? 

That finishes my introduction to the course. In the next lecture we will begin by trying 
to make sense of the question, "What is " Geometry?" Geometry seems such a familiar and 
ancient notion that you may be surprised to hear that the mathematicians current concep- 
tion of the subject underwent a substantial reformulation a little over a century ago by the 
German mathematician Felix Klein in his so-called "Erlanger Program". As preparation 
for my lecture, try looking up "Felix Klein" and "Erlanger Program" on Google. 
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Lecture 2 

What is Geometry? 



2.1 Groups of Transformations 

Let X be some set. In the following we will refer to X as "space". By a transformation 
or bijection of X we will mean a mapping / : X — > X that is "one-to-one and onto" . This 
means that: 

1) if f{xi) = f{x2) then xi = X2, 

2) every j/ in X is of the form f{x) for some x in X — which by 1) is clearly unique, 

and then the inverse of /, denoted by /~^, is defined using 2) to be the mapping of X to 
itself f~^{y) := X. 

> 2.1 — Exercise 1. Check that is also a bijection of X. 

Recall that if / and g are any two self- mappings of X, then their composition f o g is 
the mapping of X to X defined by (/ o g){x) := f{g{x)). 

> 2.1 — Exercise 2. Show that the composition of two bijections of X is again a bijection 
of X. Show by an example that composition of bijections is not necessarily commutative, 
i.e., it is not true in general that f o g = g o f. (Hint: Take for X the three element set 
{1, 2, 3}.) On the other hand, show that / o and o / are always both equal to the 
identity transformation of X, i.e., the transformtion of X that maps each elemet of X to 
itself. Show that the inverse of f o g is o f~^ . 

2.1.1 Definition. A set G of transformations of X is called a group of transformations 
of X if: 

1) it contains the identity transformation, 

2) it is closed under composition, and 

3) if a transformation / is in G then so also is f~^. 

Clearly the set Biject(X) of all transformations of X is the largest group of transforma- 
tions of X, and the set consisting of only the identity map of X is the smallest. 

> 2.1 — Exercise 3. Show that the intersection of any collection of groups of trans- 
formations of X is itself a group of transformations of X. Deduce that if S is any set 

of transformations of X, then there is is a smallest group of transformations of X that 
includes S. This group is called the group generated by S. 
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2.1.2 Felix Klein's Erlanger Program. In 1872, the German mathematician Felix 
Klein, recently appointed to a chair at Erlanger, proposed a new viewpoint towards Geom- 
etry. For centuries after Euclid, there was only Euclidean geometry, but then, in the 1800s 
many new and different geometries were introduced and studied; for example spherical ge- 
ometry, hyperbolic geometry, projective geometry, afl&ne geometry, and more. Eventually 
mathematicians felt the need to elucidate just what a geometric theory was and how to 
classify the various different geometries. Klein observed that each geometry had associated 
to it a group of transformations, the symmetry group of the geometry, and two objects of 
the geometry could be considered equivalent if there was an element of that group that 
carried one object to the other. For example, the symmetry group of Euclidean geometry 
is the so-called Euclidean Group — generated by the rotations and translations of Euclidean 
space — and two triangles are considered to be "equivalent" in Euclidean geometry if they 
are congruent, meaning that there is some element of the Euclidean group that carries one 
triangle into another. To quote Klein: 

"...geometrical properties are characterized by their invariance under a group 
of transformations." 

That last sentence epitomizes what has come to be known as Klein's Erlanger Program, 
and just what it means should gradually become more clear as we proceed. 

2.2 Euclidean Spaces and Their Symmetries 

We shall as usual denote by R"^ the space of all ordered n-tuples x = (xi, . . . of 
real numbers. The space R"^ has two important structures. The first is algebraic, namely 
R"' is a real vector space (of dimension n). If o; is a "scalar", i.e., a real number, then the 
product ax is the n-tuple {axi, . . . , axn), and if y = (yi, ...,?/„) is a second element of 
R"^, then the vector sum x + y is the n-tuple {xi+yi, . . . ,Xn + yn)- The second important 
structure is the so-called inner product, which is a real- valued function on R" x R"^, namely 
{x, y) I— > (x, y) :— xiyi + X2y2 + ■ • • + Xnyn- As we shall see, it is this inner product that 
allows us to define geometric concepts like length and angle in R"'. Sometimes the inner 
product is referred to as the "dot-product" and written as x ■ y. 

The inner product has three characteristic properties that give it its importance, namely: 

1) Symmetry: (x,y) = {y,x) for all x,y & R" 

2) Positive Definiteness: (x, x) > 0, with equality if and only if a; = 0. 

3) Bilinearity: {ax + (3y, z) = a (x, z) + (3 {y, z), for all x,y,z & R"' and all a, /? e R. 

> 2.2 — Exercise 1. Verify that {x,y) has these three properties. 
More generally: 

2.2.1 Definition. . If F is a real vector space, then a real-valued function on V x V, 
{vi,V2) ^ {vi,V2) is called an inner product for V if it is symmetric, positive definite, and 
bilinear. An inner-product space is a real vector space V together with a fixed choice of 
inner product for V. 

We recall that that for any x G R"^, we define its norm, \\x\\, by := ^/ {x, x), and of 
course, we make this same definition in any inner product space. 
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> 2.2 — Exercise 2. Show that ii x,y e R" and t e R, then ||ta; + is a quadratic 
polynomial function of t, namely: 

\\tx + yf = {tx + y,tx + y) = \\xf + 2 {x, y) t + ||y||' . 

and note the important special case 

11^ + y\\^ = ll^ll^ + 2 {x,y) + . 

Finally, for reasons we shall see a little later, the two vectors a; an y are called orthogonal 
if (x, y) — 0, so in this case we have: 

Pythagorean Identity. If x and y are orthogonal vectors in an inner product space then 

II I l|2 II ||2 I 11 ||2 

\\x + y\\ = \\x\\ + \\y\\ . 

Now let me remind you of some basic facts from high-school mathematics concerning an 
arbitrary real polynomial P{t) = at^ -|- 6t + c in a variable t. (For simplicity, we will 
assume tha a > 0.) Recall that the discriminant of P{t) is the quantity 6^ — 4ac, and 
it distinguishes what kind of roots the polynomial has. In fact, the so-called "Quadratic 
Formula" says that the two (possible complex) roots of P{t) are (— 6 ± y/b'^ — Aac)/2a. 
Thus there are three cases: 

Case 1:6^ — 4ac > 0. Then P{t) has two real roots. Between these roots P{t) is negative and 
outside of the interval between the roots it is positive. 

Case 2: 6^ — 4ac = 0. Then P(t) has only the single real root —b/2a, and elsewhere P{t) > 0. 

Case 3: 6^ — 4ac < 0. Then P{t) has no real roots and P{t) is positive for all real t. 

In the case of the polynomial \\tx + we see that a = \\x\\^, c = \\y\\^, and b = 2 {x,y), so 
the discriminant is 4(| (x, y) p — Now Case 1 is ruled out by positive definiteness. 
In Case 2, we have | (x, y) \ = \\x\\ ||y||, so if t is the root of the polynomial then ||x + = 0, 
so X = -ty, and we see that in this case x and y are linearly dependent. Finally, in Case 3, 
I {x,y) I < \\y\\, and since x + ty is never zero, x and y are linearly independent. This 
proves one of the most important inequalities in all of mathematics, 

Schvi^artz Inequality. For all x,y & R"^, | {x,y) \ < \\x\\ \\y\\, with equality if and only if 
X and y are linearly dependent. 

Of course, since our proof only used the three properties that define an inner product, the 
Schwartz Inequality is valid in any inner-product space. 

> 2.2 — Exercise 3. Use the Schwartz Inequality to deduce the Triangle Inequality: 

\\x + y\\ < \\x\\ + \\y\\ . 

(Hint: Square both sides.) 

2.2 — Example 1. Let C([a,6]) denote the vector space of continuous real-valued func- 
tions on the interval [a, 6] (with pointwise vector operations, as usual). For /, (7 G C([a,6]) 
define {f,g) = f{x)g{x) dx. it is easy to check that this satisfies our three conditions 
for an inner product. What does the Schwartz Inequality say in this case? 
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Lecture 3 

Geometry of Inner Product Spaces 



3.1 Angles 

Let X and y be two non-zero vectors in an inner product space. Then by the Schwartz 
inequality, the ratio / lies in the interval [—1, 1], so there is a unique angle 

6 between and tt such that cos(6') = {x,y) / \\x\\ \\y\\. In other words, we define 9 to 
make the identity (x, y) = \\x\\ \\y\\ cos{9) hold. What is the geometric meaning of 97 Let's 
first consider a special case. Namely take for x the unit vector in the x direction, (1,0), 
and let y be an arbitrary vector in R^. If r — \\y\\ and (p is the angle between x and 
y (the so-called polar angle of y), then clearly y = (r cos(0), r sin((/))), so it follows that 
{x,y) = (l)(rcos(0)) + (O)(rsin(0)) = rcos{(f)) and hence {x,y) / \\x\\ \\y\\ = cos(0), so in 
this case the angle 9 is exactly the angle (j) between x and y. 

> 3.1 — Exercise 1. Carry out the computation for the general case of two non-zero 

vectors in the plane with lengths ri and r2 and polar angles (pi and 4*2, so that x = 
(ri cos((^i), ri sin((/)i)) and y = (r2 cos((^2), ^2 sin((^2))- Show that in this case too the ratio 
{x, y) I is the cosine of the angle {(p\ — ^2) between x and y. (Hint: use the Cosine 

Addition Formula: cos(A ± 5) = cos(A) cos(i?) =F sin(A) sin(i?).) 

Henceforth we will refer to 9 as the angle between x and y. In particular, if {x^y) — 0, 
so that 9 = tt/2, then we say that x and y are orthogonal. 

3.2 Orthonormal Bases for an Inner Product Space 

We begin by recalling the basic facts concerning linear dependence, dimension, and bases 
in a vector space V . (If you prefer to be concrete, you may think of V as being R"^.) We 
say that vectors f 1, . . . , f„ in F are linearly dependent if there are scalars ai, . . . , not 
all zero, such that the linear combination aivi H — • + anVn is the zero vector. It is easy 
to see that this is equivalent to one of the Vi being a linear combination of the others. 
If vi, . . . are not linearly dependent, than we say that they are linearly independent. 
The vectors , . . . , w„ are said to span V if every element of V can be written as a linear 
combination of the f^, and if V is spanned by some finite set of vectors then we say that 

V finite dimensional, and we define the dimension of V, dim(y), to be the least number 
of vectors needed to span V. A finite set of vectors vi , . . . , in V is called a basis for 

V if it is both linearly independent and spans V . It is easy to see that this is equivalent 
to demanding that every element of V is a unique linear combination of the Vi. The 
following is a the basic theorem tying thse concepts together. 

Theorem. If V is an n-dimensional vector space, then every basis for V has exactly n 
elements. Moreover, if vi, . . . ,Vn is any set of n elements of V, then they form a basis 
for V if and only if they are linearly independent or if and only if they span V. In other 
words, n elements ofV are linearly independent if and only if they span V. 
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In what follows, we assume that V is an inner-product space. If v e F is a non-zero 

vector, we define a unit vector e with the same direction as V hj e := v / \\v\\. This is 
called normalizing v, and if v already has unit length then we say that v is normalized. 
We say that k vectors ei,...,ek in V are orthonormal if each Cj is normalized and if 
the Cj are mutually orthogonal. Note that these conditions can be written succinctly as 
(eijCj) = Sj, where Sj is the so-called Kronecker delta symbol and is defined to be zero if 
i and j are different and 1 if they are equal. 

> 3.2 — Exercise 1. Show that if ei, . . . ,6^ are orthonormal and v is a linear combi- 
nation of the Cj, say v = aiVi + ■ ■ ■ + a^Vk, then the ai are uniquely determined by 
the formulas ai = {v,ei). Deduce from this that orthonormal vectors are automatically 
linearly independent. 

Orthonormal bases are also referred to as frames and as we shall see they play an 
extremely important role in all things having to do with explicit computation in inner- 
product spaces. Note that if ei, Cn is an orthonormal basis for V then every element of 
y is a linear combination of the Cj, so that by the exercise each v & V has the expansion 
^ = ElLi {v,ei)ei. 

3.2— Example 1. The "standard basis" for R", is 5^ . . . , S"", where 6' = {6l,..., It 
is clearly orthonormal. 



3.3 Orthogonal Projection 

Let F be an inner product space and W a linear subspace of V. We recall that the 
orthogonal complement of W, denoted by W-^, is the set of those v inV that are orthogonal 
to every w in W. 

> 3.3 — Exercise 1. Show that W-^ is a linear subspace of V and that W fl W-'- = 0. 

If V e F, we will say that a vector w inW is its orthogonal projection onW iiu = v — w 
is in W-^. 

> 3.3 — Exercise 2. Show that there can be st most one such w. (Hint: if w' is another, 
so u' = V — u e W-^ then u — u' = w' — w is in both W and W-^.) 

3.3.1 Remark. Suppose ui e W. Then since v — oj = {v — w) + {w — u) and v — w E W-^ 
while {w — u}) e W, it follows from the Pythagorean identity that \\v — a;|| = \\v — w\\ + 
\\w — uj\\ . Thus, \\v — u\\ is strictly greater than \\v — w\\ unless u = w. In other words, 
the orthogonal projection of v on w is the unique point of W that has minimum 
distance from v. 

We call a map P : V W orthogonal projection of V onto W ii v — Pv is in for 
all f G V . By the previous exercise this mapping is uniquely determined if it exists (and 
we will see below that it always does exist). 

> 3.3 — Exercise 3. Show that ii P -.V is orthogonal projection onto W , then P 
is a linear map. Show also that if f G VF, then Pv — v and hence P^ — P. 
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> 3.3 — Exercise 4. Show that if ei, . . . ,e„, is an orthonormal basis for W and if for 

each V ^ V we define Pv := Xir=i i'^i^i) then P is orthogonal projection onto W. In 
particular, orthogonal projection onto W exists for any subspace W olV that has some 
orthonormal basis. (Since the next section shows that any W has an orthonormal basis, 
orthogonal projction on a subspace is always defined.) 



3.4 The Gram- Schmidt Algorithm 

There is a beautiful algorithm, called the Gram-Schmidt Procedure, for starting with 
an arbitrary sequence wi,W2, ■ ■ ■ ,Wk of linearly independent vectors in an inner product 
space V and manufacturing an orthonormal sequence ei, . . . , e/c out of them. Moreover it 
has the nice property that for all j < k, the sequence ei, . . . , spans the same subspace 
Wj of V as is spanned by wi, . . . , Wj. 

In case k = 1 this is easy. To say that wi is linearly independent just means that it is 
non-zero, and we take ei to be its normalization: ei := wi/ \\wi\\. Surprisingly, this trivial 
special case is the crucial first step in an inductive procedure. 

In fact, suppose that we have constructed orthonormal vectors ei, . . . , e^n (where m < k) 
and that they span the same subspace Wm that is spanned by wi, . . . ,Wm- How can we 
make the next step and construct e^+i so that ei, . . . , e^+i is orthonormal and spans the 
same subspace as zwi, . . . , Wj^j^il 

First note that since the ei,...,em are linearly independent and span Wm-, they are 
an orthonormal basis for Wm-, and hence we can find the orthogonal projection u)m+i of 
Wm+i onto Wm using the formula com+i = X^I^i {'^m+ij ^i) ^i- Recall that this means that 
^m+i = — is Orthogonal to Wm, and in particular to ei, . . . , e^^. Now em+i 

cannot be zero! Why? Because if it were then we would have Wm+i = ^^m+i £ Wm, 
so Wm+i would be a linear combination of wi, . . . , Wm, contradicting the assumption that 
wi, . . . ,Wk were linearly independent. But then we can define Cm+i to be the normaliza- 
tion of em+i, i-e., Cm+i '■= ^m+i/ lkm+i ||) and it follows that Cm+i is also orthogonal to 
ei, . . . , Cm, so that ei, . . . , Cm+i is orthonormal. Finally, it is immediate from its definition 
that Cm+i is a linear combination of ei,...,em and Wm+i and hence of wi, . . . ,Wm+i, 
completing the induction. Let's write the first few steps in the Gram-Schmidt Process 
explicitly. 



1 


ei 


:= wi/ 




% Normalize wi to get ei. 


2a 




■■= {W2, 


,ei) ei. 


% Get projection 002 of W2 on Wi, 


2b 


£2 : 


■■= W2 - 


- U2. 


% subtract uj2 from W2 to get W^ component €2 of W2, 


2c 




:=e2/|| 


k2||. 


% and normalize it to get 62- 


3a 


Us 


:= {W3. 


, ei)ei -1- (^3,62) 


62- % Get projection u>s of ws on W2, 


3b 




:= ws - 


- ^3. 


% subtract lv^ from ws to get W^ component €3 of W3 


3c 


63 


■= es/ II 


kail- 


% and normalize it to get 63. 



9 



Math 32a Fall 2003 



R. Palais 



If is a fc-dimensional subspace of an n-dimensional inner-product space V then we can 
start with a basis for for W and extend it to a basis for V. If we now apply Gram-Schmidt 
to this basis, we end up with an orthonormal basis for V with the first k elements in W 
and with the remaining n — k in W-^. This tells us several things: 

• W-^ has dimension n — k. 

• V is the direct sum of W and W^. This just means that every element of V can be 
written uniquely as the sum w + u where w E W and u E W-^. 

• (W^)^ = W. 

• If P is the orthogonal projection of V on W and / denotes the identity map of V then 
/ — P is orthogonal projection of V on W-^. 

> Project 1. Implement Gram-Schmidt as a Matlab 
Function 

In more detail, create a Matlab M-file GramSchmidt.m in which you define a Matlab 
function GramSchmidt(M) taking as input a rectangular matrix M of real numbers of 
arbitrary size m x n, and assuming that the m rows of M are linearly independent, it 
should transform M into another m x n matrix in which the rows are orthonormal, and 
moreover such that the subspace spanned by the first k rows of the output matrix is the 
same as the space spanned by the first k rows of the input matrix. Clearly, in writting 
your algorithm, you will need to know the number of rows, m and the number of columns 
n of M. You can find these out using the Matlab size function. In fact, size(M) returns 
(m,n) while size(M,l) returns m and size(M,2) returns n. Your algorithm will have to do 
some sort of loop, iterating over each row in order. Be sure to test your function on a 
number of different matrices of various sizes. What happens to your function if you give 
it as input a matrix with linearly dependent rows. (Ideally it should report this fact and 
not just return garbage!) 
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Lecture 4 

Linear Maps And The Euclidean Group. 



I assume that you have seen the basic facts concerning linear transformations and ma- 
trices in earlier courses. However we will review these facts here to establish a common 
notation. In all the following we assume that the vector spaces in question have finite 
dimension. 



4.1 Linear Maps and Matrices 

Let V and W be two vector spaces. A function T mapping V into W is called a linear 
map if T{avi+ PV2) = aT{vi) + PT{v2) for all scalars a, (3 and all vi, V2 G V. We make the 
space L(y, W) of all linear maps of V into W into a vector space by defining the addition 
and scalar multiplication laws to be "pointwise". i.e., if /S, T e L{V,W), then for any 
veVwe define {aT + pS){v) := aT{v) + l3S{v) 

4.1.1 Remark. If f i, . . . , f„ is any basis for V and wi, . . . , w„ are arbitrary elements of 
W, then there is a unique T e L(V, W) such that T{vi) = uji. For ii v & V , then v has 
a unique expansion of the form v = Yl7=i ^i'^ii then we can define T by T{v) := 
Yl7=i '^i'^i-i it is easily seen that this T is linear, and that it is the unique linear 
transformation with the required properties. 

In particular, if wi, . . . , Wm is a basis for W , then for 1 < i < n and 1 < j < m we define 
Eij to be the unique element of L(y, W) that maps Vi to Wj and maps all the other Vk to 
the zero element of W . 

4.1.2 Definition. Suppose T : V ^ W is a linear map, and that as above we have a 
basis Vi, . . . for V and a basis Wi, . . . , Wm for W . For 1 < J < n, the element Tvj of 
W has a unique expansion as a linear combination of the Wi, T{vj) = Xli^li TijWi. These 
mn scalars Tij are called the matrix elements of T relative to the two bases Vi and Wj. 

4.1.3 Remark. It does not make sense to speak of the matrix of a linear map until bases 
are specified for the domain and range. However, if T is a linear map from R"^ to R"^, 
then by its matrix we always understand its matrix relative to the standard bases for R" 
and R"'. 

4.1.4 Remark. If 1/ is a vector space then we abrcviatc L{V, V) to L{V)j and wc often 
refer to a linear map T : V V as a, linear operator on V. To define the matrix of a linear 
operator on V we only need one basis for V. 

> 4.1 — Exercise 1. Suppose that v E V has the expansion v = Yl^=i^3'^3i thaX 
Tv G W has the expansion Tv = YllLi PiWi- Show that we can compute the components 
(3i of Tv from the components aj of v and the matrix for T relative to the two bases, using 
the formula (3i = JZ^^i '^ij'^j- 
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Caution! Distinguish carefully between the two formulas: T{vj) = Y^^i'^ij'^i Pi — 
Yl^=i '^ij^j- "^^^ ^^^^ essentially the definition of the matrix Tij while the second is the 
formula for computing the components of Tv relative to the given basis for W from the 
components of v relative to the given basis for V. 

> 4.1 — Exercise 2. Show that T = Yl7=i '^JLi'^ij^ij^ deduce that Eij is a basis 
for L{V, W), so in particular, L{V, W) has dimension nm, the product of the dimensions 
of V and W. 

4.2 Isomorphisms and Automorphisms 

If V and W are vector spaces, then a linear map T : V ^ W is called an isomorphism 
of V with W if it is bijective (i.e., one-to-one and onto), and we say that V and W are 
isomorphic if there exists an isomorphism of V with W. An isomorphism of V with itself is 
called an automorphism of V, and we denote the set of all automorphisms of V by GL{V). 
{GL{V) is usually referred to as the general linear group of V — check that it is a group.) 

> 4.2 — Exercise 1. If T : V ^ W is a linear map and fi, . . . .Vn is a basis for V then 
show that T is an isomorphism if and only if Tvi, . . . ,Tvn is a basis for W. Deduce 
that two finite-dimensional vector spaces are isomorphic if and only if they have the same 
dimension. 

There are two important linear subspaces associated to a linear map T : F — > W. The 
first, called the kernel of T and denoted by ker(T), is the subspace of V consisting of all 
V ^ V such that T{v) = 0, and the second, called the image of T, and denoted by im(T), 
is the subspace of W consisting of all w & W of the form Tv for some v E V. 

Notice that if vi and V2 are in V, then T{vi) — T(f 2) if and only if T(vi — V2) = 0, i.e., 
if and only if vi and f 2 differ by an element of ker(T). Thus T is one-to-one if and only if 
ker(T) contains only the zero vector. 

Proposition. A necessary and sufficient condition for T : V ^ W to be an isomorpfiism 
of V witli im(T) is for ker(T) to be the zero subspace of V. 

Theorem. If V and W are finite dimensional vector spaces and T : V ^ W is a linear 
map, then dim(ker(T)) + dim(im(T)) = dim(F). 

PROOF. Choose a basis vi, . . . ,Vk for ker(T) and extend it to a basis vi, . . . ,Vn for all 
of V. It will suffice to show that T{vk+i), ■ ■ ■ , T{vn) is a basis for im(T). We leave this as 
an (easy) exercise. 

Corollary. If V and W have the same dimension then a linear map T : V ^ W is an 
isomorphism of V with W if it is either one-to-one or onto. 

Recall that if V is an inner product space and V\,V2 G V^, then we define the distance 
between Vi and V2 as ^(^1,^2) := H'^i — f2||- This makes any inner-product space into a 
metric space. A mapping f : V ^ W between inner-product spaces is called an isometry 
if it is distance preserving, i.e., if for all vi,V2 G V, \\f{vi) — f{v2)\\ = \\vi — f2||- 
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4.2.1 Definition. If V is an inner product space then we define the Euclidean group of 
V, denoted by Euc{V), to be the set of all isometries f : V ^ V. We define the orthogonal 
group of V, denoted by 0{V) to be the set of / e Euc{V) such that /(O) = 0. 

4.2.2 Remark. We will justify calling Euc{V) a group shortly. It is clear that Euc{V) 
is closed under composition, and that elements of Euc{V) are one-to-one, but at this point 
it is not clear that an element / of Euc{V) maps onto all of V, so / might not have an 
inverse in Euc{V). A similar remark holds for 0{V). 

Proposition. If f E 0{V) then f preserves inner-products, i.e., if vi,V2 G V then 

{fVl,fV2) = {V1,V2). 

PROOF. Clearly / preserves norms, since = \\fiv) — /(0)|| = \\v — 0|| = \\v\\, and 

we also know that, ||/(fi) — /(f2)||^ = l^i — 1'2||^- Then (/t'i,/t'2) = {vi,V2) now follows 
easily from the polarization identity in the form: {v,w) = ^(ll'^^ll + ll'^^ll ~ 11'*^ ~ '*^|| )• 

Theorem. 0{V) C GL{V), i.e., elements of 0{V) are invertible hnear transformations. 

PROOF. Let ei, . . . , Cn be an orthonormal basis for V and let = /(cj). By the preceding 
proposition {€i,ej) = {ei,ej) = Sj, so that the also form an orthonormal basis for V. 
Now suppose that vi,V2 G V and let ai,/?i and , 7^ be respectively the components of 
Vi,V2, and Vi + V2 relative to the orthonormal basis e^, and similarly let a[, I3[ and , 7^ be 
the components of /(fi),/(f2), and f{vi + V2) relative to the orthonormal basis e^. To 
prove that f{vi + V2) = f{vi) + f{v2) it will suffice to show that 7^ = + (3'^. Now we 
know that = on + so it will suffice to show that a[ = ai, (5[ = and 7^ = 7i- But 
since = e^) while a'^ = {f{vi), e^) = {f{vi), f{ei)), a'- = ai follows from the fact that 
/ preserves inner-products, and the other equalities follow likewise.. A similar argument 
shows that f{av) = af{v). Finally, since / is linear and one-to-one, it follows that / is 
invertible. ■ 

4.2.3 Remark. It is now clear that we can cquivalently define 0(y) to be the set of 
linear maps T -.V that preserves inner-products. 

Every a eV gives rise to a map Ta : V ^ V called translation by a, defined by, Ta{v) = 
V + a. The set T{V) of all Ta,a E V is clearly a group since Ta+b — Ta° Tb and tq is the 
identity. Moreover since (f 1 + a) — {y2 + a) = f 1 — f 2, it follows that Ta is an isometry, i.e. 
T{V) C Euc{V) 

Theorem. Every element f of Euc{V) can be written uniquely as an orthogonal trans- 
formation O followed by a translation Ta. 

PROOF. Define a := /(O). Then clearly the composition T_a o / leaves the origin fixed, 
so it is an element O of 0{V), and it follows that / = Ta o O. (We leave uniqueness as an 
exercise.) 

CoroUeiry. Every element f of Euc{V) is a one-to-one map ofV onto itself and its inverse 
is also in V, so Euc{V) is indeed a group of transformations of V. 

PROOF. In fact we see that /"^ = 0"^ o T-a- 
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Lecture 5 

Adjoints of Linear Maps and The Spectral Theorem 



5.1 The Dual Vector Space of a Vector Space 

If F is a vector space then the vector space L(V, R) of linear maps of V into the one- 
dimensional vector space of scalars, R plays an important role in many considerations. 
It is called the dual space of V and is denoted by V*. Elements of V* are called linear 
Junctionals on V . 

5.1.1 Remark. If vi, . . . ,Vn is any basis for V, then (since 1 is a basis for R) it follows 
from 4.1.1 that there is a uniquely determined basis £i, for V* such that £i{vj) — 5]. 

This is called the dual basis to vi, . . . ,Vn- In particular, V* has the same dimension as V. 



5.2 The Self-Duality of Inner-Product Spaces 

If V is an inner-product space, then there is an important way to represent elements of 
V* . Namely, recall that the inner-product is linear in each variable when the other variable 
is held fixed. This means that for each vector v & V we can define an element v* : V ^ H 
of V* by the formula := {x,v). Since the inner product is linear in both variables, 

it follows that the map v i— > is linear. If v* = 0, then in particular = v*{v) = (w, w), so 
by positive definiteness v = 0, i.e., the kernel of the map v ^ v* is zero, and since V and 
V* have the same dimension, it follows that this map is an isomorphism — i.e., every linear 
functional on an inner-product space V can be expressed uniquely as the inner-product 
with some fixed element of V. This is often expressed by saying that inner- product spaces 
are "self-dual". 

5.2.1 Remark. Note that if is an orthonormal basis for V, then e* is the dual basis 
for V*. 

5.3 Adjoint Linear Maps 

Now let V and W be finite dimensional inner-product spaces and T : V ^ W a, linear 
map. We will next define a linear map T* : W ^ V called the adjoint of T that satisfies 
the identity {Tv,w) = {v,T*w) for all f G ^ and all w G W. 

If we fix w in W, then to define T*w we note that the map v {Tv, w) is clearly a 
linear functional on V, i.e., an element of V* , so by self-duality there is a uniquely defined 
element T*w in V such that {v, T*w) = {Tv, w) for aU v in V. 

We recapitulate the above as a formal definition. 
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5.3.1 Definition. Let V, W be finite dimensional inner-product spaces and T e L{V, W). 
The adjoint of T is the unique element T* e L{W, V) satisfying the identity: 

{v,T*w) = {Tv,w). 

Here are some exercises involving adjoints and their basic properties. 

> 5.3 — Exercise 1. Show that (T*)* = T. 

> 5.3 — Exercise 2. Recall that if Tij is an m x n matrix (i.e., m rows and n columns) 
and Sji an n X m matrix, then Sji is called the transpose of Tij if Tij = Sji for 1 < i < m, 
^ ^ j ^ n. Show that if we choose orthonormal bases for V and W, then the matrix of T* 
relative to these bases is the transpose of the matrix of T relative to the same bases. 

> 5.3 — Exercise 3. Show that ker(T) and im(T*) are orthogonal complements in V, 
and similarly, im(T) and ker(T*) are each other's orthogonal complements in W. (Note 
that by Exercise 1, you only have to prove one of these.) 

> 5.3 — Exercise 4. Show that a linear operator T on F is in the orthogonal group 0{V) 
if and only if TT* = I (where / denotes the identity map of V) or equivalently, if and only 
if T* = T-^ 

If T : y — > y is a linear operator on V, then T* is also a linear operator on V, so it makes 
sense to compare them and in particular ask if they are equal. 

5.3.2 Definition. A Unear operator on an inner-product space V is called self-adjoint if 
T* = T, i.e., if {Tvi,V2) = {vi,Tv2) for all vi,V2 e V. 

Note that by Exercise 3 above, self-adjoint operators are characterized by the fact that 
their matrices with respect to an orthonormal basis are symmetric. 

> 5.3 — Exercise 5. Show that if is a linear subspace of the inner-product space V, 
then the orthogonal projection P of F on is a self-adjoint operator on V. 

5.3.3 Definition. If T is a linear operator on V, then a linear subspace U C.V is called 
a T-invariant subspace if T(U) C U, i.e., ii u E U implies Tu e U. 

5.3.4 Remark. Note that if [/ is a T-invariant subspace of V, then T can be regarded 
as a linear operator on U by restriction, and clearly if T is self-adjoint, so is its restriction. 

> 5.3 — Exercise 6. Show that if T : F — > F is a self-adjoint operator, and U C F is a 
T-invariant subspace of V, the t/-*- is also a T-invariant subspace of V. 



5.4 Eigenvalues and Eigenvectors of a Linear Operator. 

In this section, T : V ^ V is a linear operator on a real vector space V. If A is a real 
number, then we define the linear subspace E\{T) of V to be the set oi v eV such that 
Tv — Xv. In other words, if / denotes the identity map of V, then Ex(T) — ker(T — XI). 
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Of course the zero vector is always in Ex{T). If Ex{T) contains a non-zero vector, then 
we say that A is an eigenvalue of T and that E\ (T) is the A-eigenspace of T. A non-zero 
vector in E\(T) is called an eigenvector of T belonging to the eigenvector A. The set of all 
eigenvalues of T is called the spectrum of T (the name comes from quantum mechanics) 
and it is denoted by Spec(T). 

> 5.4 — Exercise 1. Show that a linear operator T on V has a diagonal matrix in a 
particular basis for V if and only if each element of the basis is an eienvector of T, and 
that then Spec(T) consists of the diagonal elements of the matrix. 

The following is an easy but very important fact. 

Theorem. If T is a self-adjoint linear operator on an inner-product space V and Ai,A2 
are distinct real numbers, then Ex^{T) and E\^{T) are orthogonal suhspaces of V . In 
particular, eigenvectors of T that belong to different eigenvalues are orthogonal. 

> 5.4 — Exercise 2. Prove this theorem. (Hint: Let Vi e E\.(T),i = 1,2. You must 
show that (^1,^2) = 0. Start with the fact that {Tvi,V2) = {vi,Tv2).) 

A general operator T on a vector space V need not have any eigenvalues, that is, Spec(T) 
may be empty. For example a rotation in the plane (by other than tt or 2n radians) clearly 
has no eigenvectors and hence no eigenvalues. On the other hand self-adjoint operators 
always have at least one eigenvector. That is: 

Spectral Lemma. If V is an inner-product space of positive, finite dimension and if 
T -.V is a self-adjoint operator on V, then Spec(T) is non-empty, i.e., T has at least 
one eigenvalue and hence at least one eigenvector. 

We will prove this result later after some preparation. But next we show how it leads to 
an easy proof of the extremely important: 

Spectral Theorem for Self- Adjoint Operators. If V is an inner inner-product space 
of posiive, finite dimension and T : V ^ V is a self-adjoint operator on V, then V has an 
orthonormal basis consisting of eigenvectors ofT. In other words, T has a diagonal matrix 
in some orthonormal basis for V. 

PROOF. We prove this by induction on the dimension n of V. If n = 1 the theorem is 
trivial, since any non-zero vector in V is clearly an eigenvector. Thus we can assume that 
the theorem is valid for all self-adjoint operators on inner-product spaces of dimension 
less than n. By the Spectral Lemma, we can find at least one eigenvector w for T. Let 
ei = and let W be the one-dimensional space spanned by w. The fact that w is 

an eigenvector implies that is a T-invariant linear subspace of V, and by 5.3, so is W-^. 
Since has dimension n — 1, by the inductive hypothesis T restricted to W-^ has an 
orthonormal basis 62, • • • -Cn of eigenvectors of T, and then ei, . . . , is an orthonormal 
basis of V consisting of eigenvectors of T. 
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5.5 Finding One Eigenvector of a Self- Adjoint Operator 

In this section we will outline the strategy for finding an eigenvector v for a self-adjoint 
operator T on an inner product space V. Actually carrying out this strategy will involve 
some further preparation. In particular, we will need first to review the basic facts about 
differential calculus in vector spaces (i.e., "multivariable calculus"). 

We choose an orthonormal basis ei, . . . , for V, and let denote the matrix of T in 
this basis. 

We define a real- valued function F on F by F{x) — {Tx,x). F is called the quadratic 
form on V defined by T. The name comes from the following fact. 

> 5.5 — Exercise 1. Show that if x = XiCi + ■ ■ • + XnC^ then F{x) = 'Y^^ j=i'^ij^i^3i 
and using the symmetry of Tij deduce that ^ = 2 Xlfc=i TikXk- 

We will denote by S{V) the set {x G ^ | = 1}, i.e., the "unit sphere" of normalized 
vectors. Note that if x = xiCi + ■ ■ ■ + Xnen, then x G S{V) if and only if + ■ ■ ■ + = 1, 
so if we define G:V ^Khy G{x) :^ xj + ■ ■ ■ + xl - 1, then S{V) ^ {x e V \ G{x) = 0}. 

5.5.1 Remark. Now Tij = ^ = 2 Ylk=i '^ik^k is just twice the i-th component of Tx in 
the basis ej. On the other hand = 2xi, which is twice the i-th component of x in this 
basis. It follows that a point x of S{V) is an eigenvector of T provided there is a constant 
A (the eigenvalue) such that §^{x) — ^§^{x). If you learned about constrained extrema 
and Lagrange multipliers from advanced calculus, this should look familiar. Let me quote 
the relevant theorem. 

Theorem on Constrained Extrema. Let F and G be two differentiable real-valued 
functions on R", and deGne a "constraint surface" S C R" by S = {x e V \ G{x) ~ 0}. 
Let p & S be a point where F assumes its maximum value on S, and assume that the 
partial derivatives of G do not all vanish at p. Then the partial derivatives of F and of 
G are proportional at p, i.e., there is a constant X (the "Lagrange Multiplier") such that 



(We will sketch the proof of the Theorem on Constrained Extrema in the next lecture.) 

Thus, to find an eigenvector of T, all we have to do is choose a point of S{V) 
where the quadratic form F{x) = {Tx,x) assumes its mcLximum value on S{V). 



dF 
dxi 




(x) for i = 1, . . . ,n. 
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Lecture 6 

Differential Calculus on Inner-product Spaces 



In this section, we will use without proof standard facts that you should have seen in your 
multi-variable calculus classes. 

6.1 Review of Basic Topology. 

V will denote a finite dimensional inner-product space, and ei, . . . , Cn some orthonormal 
basis for V. We will use this basis to identify R" with F, via the map {xi,. . . ,a;„) i— > 
XiCi + • • • + XnCn, and we recall that this preserves inner-products and norms, and hence 
distances between points. In particular, this means that a sequence f = f ^ei + . . . +v^en 
of vectors in V converges to a vector v = viCi + . . . + VnCn if an only if each of the n 
component sequences vf of real numbers converges to the corresponding real number Vi, 
and also, that the sequence v'' is Cauchy if and only if each component sequence of real 
numbers is Cauchy. This allows us to reduce questions about convergence of sequences in 

V to more standard questions about convergence in R. For example, since R is complete 
( i.e., every Cauchy sequence of real numbers is convergent) it follows that V is also 
complete. 

Recall that a subset S of R"' is called compact if any sequence of points in S has a sub- 
sequence that converges to a point of S, and the Bolzano-Wcierstrass Theorem says that 
S is compact if and only if it is closed and bounded. (Bounded means that | s G 5"} is 
a bounded set of real numbers, and closed means that any limit of a sequence of points of 
S is itself in 5.) Because of the distance preserving identification of V with R" it follows 
that for subsets of V too, compact is the same as closed and bounded. 

> 6.1 — Exercise 1. Recall that a set O Q V is called open if whenever p E O there is 
an e > such that ||a; — < e implies that x E O. Show that O is open in V if and only 
if its complement is closed. 

If S C V and f : S ^ W is a map of S into some other inner-product space, then / is 
called continuous if whenever a sequence Sk in S converges to a point s of 5", it follows 
that f{sk) converges to f{s). (More succinctly, liuik^oo f{sk) = /(hnifc^oo Sfc), so one 
sometimes says a map is continuous if it "commutes with taking limits".) 

> 6.1 — Exercise 2. Show that if f : S ^ W is continuous, then if A is an open (resp. 
closed) subset of VF, then f~^{A) is open (resp. closed) in S. Deduce from this that S{V), 
the unit sphere of V, is a closed and hence compact subset of V. 

\> 6.1 — Exercise 3. Show that any continuous real- valued function on a compact subset 
S of V must be bounded above and in fact there is a point s of S* where / assumes its 
maximum value. (Hint #1: If it were not bounded above, there would be a sequence Sn 
such that f{sn) > n. Hint #2: Choose a sequence s„ so that /(s^) converges to the least 
upper bound of the values of /.) 
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6.2 Differentiable maps Between Inner-Product Spaces. 

In this section, V and W are inner-product spaces. 

The key concept in differential calculus is approximating a non-linear map f : V ^ W 
near some point p, by a linear map, T, called its differential at p. To be more precise, if v 
is close to zero, we should have f{p + f ) = /(p) + Tv + Rp{v) where the error term Rp{v) 
should be "small" in a sense we shall make precise below. 

We start with the one-dimensional case. A map a : {a,b) ^ V of an interval (a, b) into V 
is called a curve in V. and it is said to be differentiable at the point to ^ (^5 if the limit 
a' (to) :— lim/j_>o exists. Note that this limit a' (to) is a vector in V, called the 

derivative (or the tangent vector or velocity vector) of cr at to- In this case, the differential 
of a at to is the linear map Dat^ : R — > F defined by Dat^it) = ta'{to)., so that the error 
term is Rp{t) = a{to + t) — cr(to) — t(T'{to). Thus, not only is Rp{t) small when t is small, 
but even when we divide it by t the result, ""(*o+t)-o-(to) _ a' (to), is still small and in fact 
it approaches zero as t 0. That is, we have o"(to +t)= o"(^o) + Dat^^{t) + \t\p{t) where 
\p{f) \ — > as t — > 0. We use this to define the notion of differentiability more generally by 
analogy. 

6.2.1 Definition. . Let O be open m. V , F : O ^ W a, map, and p E O. We say that 
F is differentiable at p if there exists a linear map T : V ^ W such that for v near in 
F, F{p + v) ^ F{p) + T{v) + \\v\\ p{v) where p{v) := np+v)-np)-T{v) ||^|| ^ q_ 
We call T the differential of F at p and denote it by DFp. If F : O — > is differentiable 
at each point of O and if DF : O — > L{V,W) is continuous we say that F is continuously 
differentiable (orC^) in O. 

6.2.2 Definition. Assuming F : O — > is as above and is differentiable at p e O, then 
for V &V,we call DFp{v) the directional derivative of F at p in the direction v. 

> 6.2 — Exercise 1. Show that DFp is well-defined, i.e., S :V is a second linear 
map satisfying the same property as T, then necessarily S = T. (Hint: By subtraction 
one finds that for all v close to zero ^^^'^"y^ij''^''^^ — >Oas||v||— >0. If one now replaces v by 
tv and uses the linearity of S and T, one finds that for fixed v, ^^^'^"ji^ii^^^^^ — > as t — > 0.) 

Chain Rule. Let U, V, W he inner-product spaces, Q an open set of U and O and open 
set of V. Suppose that G : Q ^ V is differentiable at lo E and that F : O ^ W 
is differentiable at p = G{u) e O. Then F o G is differentiable at uj and D{F o G)^ = 
DFp o DG^. 

> 6.2 — Exercise 2. Prove the Chain Rule. 

> 6.2 — Exercise 3. Show that if p,v E V then the map a : H ^ V, cr(t) — p + tv is 
differentiable at all to ^ R and that a"'(to) = v for all to G R. More generally, if wq E W 
and T e L{V, W) show that F : V ^ W defined by F{v) := wq + Tv is differentiable at 
all vo in V and that DFy^ = T. (So a linear map is its own differential at every point.) 

Using the Chain Rule, we have a nice geometric interpretation of the directional derivative. 
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> 6.2 — Exercise 4. Let F : O ^Whe differentiable at p, let v eV. Let a -.K^V he 

any curve in V that is differentiable at to with cr(to) = p and o"'(to) = v. Then the curve 
in W, F o a : H. W is also differentiable at to and its tangent vector at to is DFp{v), 
the directional derivative of F at p in the direction v. 



6.3 But Where Are All the Partial Derivatives? 

Let's try to tie this up with what you learned in multi-variable calculus. As above, let 
us assume that O is open in V and that F : O — > is differentiable at p e O. Let 
ei, . . . , e„ be an orthonormal basis for V and ei, . . . , e^n be an orthonormal basis for W, 

and let p = piCi -\ h PnCn- 

If a; = XiCi^- ■ ■ + .T„e„ is in O, then its image F[x) G W will have an expansion in the basis 

ei, F{x) = Fi{x)ei-\ \-Fm{x)em- If as usual we identify x with its n-tuple of components 

{xi, . . . , Xn), then we have m functions of n variables, Fi{xi, . . . , Xn), ■ • ■ , Fm{xi, . . . , Xn) 
that describe the mapping F relative to the two bases Cj and ej. 

\> 6.3 — Exercise 1. Show that the partial derivatives of the Fi at (pi, . . . ,pn) all exist, 
and in fact, show that the ^^^(p^^---'P^) qj^-q ^j^g components of the directional derivative of 
F at p in the direction ej relative to the basis e^. 

> 6.3 — Exercise 2. The n x m matrix 9^^(p^^---'P^) jg called the Jacobian matrix of F 

at p (relative to the two bases ej and e^). Show that it is the matrix of DFp relative to 
these two bases, so that if v — viCi H — ■ + Vnen then the i-th component of the directional 
derivative of F at p in the direction v is Yl^=i ^ij'^j- 

6.3.1 Remark. It is clear from these exercises that differentials and Jacobian matrices 
are logically equivalent. So which should one use? For general theoretical discussions it 

is usually more natural and intuitive (and easier) to reason directly about differentials of 
maps. However, when it comes to a question concerning a particular map F that requires 
computing some of its properties, then one often must work with its partial derivatives to 
carry out the necessary computations. 

The following is a standard advanced calculus result that provides a simple test for when 
a map F : O ^ W such as above is C^. 

Theorem. A necessary and sufficient condition for a map F : O ^ W as above to be 
is that all its partial derivatives are continuous functions on O. 

> 6.3 — Exercise 3. Consider the map F : ^ R defined by F{x, y) = for 
(x, y) 7^ (0, 0) and F(0, 0) = 0. Show that the partial derivatives of F exist everywhere 
and are continuous except at the origin. Show also that F is actually linear on each straight 
line through the origin, but nevertheless F is not differentiable at the origin. (Hint: In 
polar coordinates, F = rsin(26') cos(6').) 
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6.4 The Gradient of a Real- Valued Function 

Let's specialize to the case W = Ti, i.e., we consider a difFerentiable real- valued function 
/ : V — > R (perhaps only defined on an open subset O of V). In this case it is customary 
to denote the differential of / at a point p by dfp rather than Dfp. Notice that dfp is in 
the dual space V* — L{V,R) of V. We recall the "meaning" of dfp, namely dfpiv) is the 
directional derivative of / in the direction v, i.e., the rate of change of / along any path 
through p in the direction v. So if a{t) is a smooth curve in V with cr(0) = p and with 
tangent vector cr'(O) = v aX p, then dfp(v) = ( J^)t=o/('^(^))- 

Next recall the self-duality principle for inner-product spaces: any £ of V* can be expressed 
in the form i{v) = {v,uj) for a unique uj & V . So in particular, for each p & O, there is a 
unique vector V/p in V such that 

dfp{v) = {v,Vfp) , 

and the vector V/p defined by this identity is called the gradient of / at p. 

A set of the form f~^{a) = {v e V \ f{v) = a} (where a e R) is called a level set of / and 
more precisely the a- level of /. 

> 6.4 — Exercise 1. Show that if the image of a diffcrentiablc curve a : {a,b) ^ V is in 
a level set of / then Vfcr{t) is orthogonal to cr'it). (Hint: The derivative of f{a{t)) is zero.) 

A point p where df (or V/) vanishes is called a critical point of /. So for example any 
local maximum or local minimum of / is a critical point. 

> 6.4 — Exercise 2. If p is not a critical point of / then show that is the unit vector 

in the direction in which / is increasing most rapidly, and that ||V/p|| is the magnitude of 
this rate of increase. (Hint: Use the Schwartz inequality.) 

> 6.4 — Exercise 3. Suppose that u : (a, 6) — > F and 7 : (a, 6) — > F are differentiable 

curves. Show that ^ {a{t),^{t)) = {a'{t),j{t)) + {a{t),Y{'t))i and in particular \\cr{t)\f = 
2 {a{t),a'{t)). Deduce that if a : {a,b) ^ V has its image in the unit sphere S{V) then 
a{t) and cr'(t) are orthogonal. 

> 6.4 — Exercise 4. For p G S{V), define TpS{V), the tangent space to S{V) at p, to be 
all V ^ V of the form cr'(to) where a{t) is a differentiable curve in S{V) having cr(to) = P- 
By the previous exercise, p is orthogonal to everything in TpS{V). Show that conversely 
any v orthogonal to p is in TpS{V), so the tangent space to S{V) at p is exactly the 
orthogonal complement of p. (Hint: Define cr{t) := cos(||v|| t)p-|- sin(||v|| jj^- Check that 
(7(0) = p, a'{t) = V, and that a{t) e S{V) for aU t. 

> 6.4 — Exercise 5. Let T be a self-adjoint operator on V and define f : V ^ H hy 
f{v) := \ {Tv,v). Show that / is differentiable and that Vfv = Tv. 

Proof of Spectral Lemma. We must find a p in SiV) that is an eigenvector of the 
self-adjoint operator T : V ^ V. By Exercise 4 we must show that V/p is a multiple of p. 
But by Exercise 4, the scalar multiples of p are just those vectors orthogonal to TpS{V), 
so it will suffice to find p witht V/p orthogonal to TpS{V). If we choose p a point of S{V) 
where / assumes its maximum value on S{V), that is automatic. 
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Lecture 7 

Normed Spaces and Integration 



7.1 Norms for Vector Spaces. 

Recall that a metric space is a very simple mathematical structure. It is given by a set 
X together with a distance function for X, which is a mapping p from X x X — > R that 
satisfies three properties: 

• Positivity: p{x-i_,X2) > with equality if and only if xi = X2- 

• Symmetry: p{xi,X2) = p{x2,xi). 

• Triangle Inequality: p{xi,X3) < p{xi,X2) + p{x2,X3). 

(You should think of the triangle inequality as saying that "things close to the same thing 
are close to each other".) 

For the metric spaces that turn up in practice, X is usually some subset of a vector space 
V and the distance function p has the form p{xi,X2) = N(xi — X2) where the function 
N -.V ^ H is what is called a "norm" for V, 

7.1.1 Definition. A real- valued function on a vector space V is called a norm for V if 
it satisfies the following three properties: 

• Positivity: N{v) > with equality if and only if v = 0. 

• Positive Homogeneity: N{av) = \a\N{v). 

• Triangle Inequality: iV(a;i + 0:2) < iV(a;i) + iV(a;2). 

If A?" is a norm for V then we call p^{xi, X2) ■= N{xi —X2) the associated distance function 
( or metric) for V. A vector space V together with some a choice of norm is called a normed 
space, and the norm is usually denoted by || ||. If V is complete in the associated metric 
(i.e., every Cauchy sequence converges), then V is called a Banach spacee. 

> 7.1 — Exercise 1. Show that if A" is a norm for V then p^^ really defines a distance 
function for V. 

7.1.2 Remark. We have seen that for an inner-product space V, we can define a norm 
for V by \\v\\ := ^/ {v, v). Moreover, we could then recover the inner-product from this 
norm by using the so-called polarization identity: ||a;-|-j/||^ = ||a;||^ + ||y||^-|-2(a;,y). 
It is natural to wonder if every norm "comes from an inner product" in this way, or 
if not which ones do. The answer is quite interesting. If we replace y by —y in the 
polarization identity and then add the result to the original polarization identity, we get 

2 ||2 iiii2 iiii2 

If + J/II + lF~y|| = 2|f|| -I- 2 ||y|| . This has a nice interpretation: it says that the 
sum of the squares of the two diagonals of any parallelogram is equal to the sum of the 
squares of the four sides — and so it is called the Parallelogram Law. It is a pretty (and 
non-obvious!) fact that the Parallelogram Law is not only a necessary but also a sufficient 
condition for a norm to come from an inner product. 
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There is a remarkable fact about linear maps between normed spaces: if they have even a 
hint of continuity then they are very strongly continuous. To be precise: 

7.1.3 Theorem. Let V and W be normed spaces and T -.V a linear map from V 

to W. Then the following are equivalent: 

1 ) There is at least one point vq eV where T is continuous. 

2) T is continuous at 0. 

3) There is a constant K such that \\Tv\\ < K \\v\\ for all v eV . 

4) T satisfies a Lipschitz condition. 

5) T is uniformly continuous. 

PROOF. First note that since \\{xn + y) — {x + y)\\ = — x\\ it follows that a;„ ^ a; is 
equivalent to {xn + y) ^ {x + y), fact we will use several times 

Assume 1) and let Vn —>■ 0- Then (vn + vo) — > fo, so by 1) T{vn+vo) Tvq, or by linearity, 
Tvn + Tvq Tvq; which is equivalent to Tvn 0, hence 1) implies 2). Assuming 2), we 



< 1. Now 



Sv 



can find a 5 > such that if \\x\\ < 5 then \\T{x 

hence \\Tv\\ < K \\v\\ where = |-, so 2) implies 3). Since Tvi — Tv2 
implies that K is a Lipschitz constant for T, and finally 4) =^ 5) 



so 



< 1, 



v\\) 

T{vi - V2), 3) 
1) is trivial. 



> 7.1 — Exercise 2. Show that if V and W are finite dimensional inner-product spaces 
then any linear map T : V ^ W is automatically continuous. Hint: Choose bases, and 
look at the matrix representation of T. 



7.1.4 Remark. This theorem shows that if T : 1/ — > is continuous, then T is bounded 
on the unit sphere of V. Thus |||T||| := supy^n^j^ ll^^^ll is well-defined and is called the 
norm of the linear map T. It is clearly the smallest Lipschitz constant for T. 



7.1.5 Extension Theorem For Continuous Linear Maps. Let V be a normed 

space, U a linear subspace ofV, W a Banach space, and T : U ^ W a continuous linear 
map. Then T has a unique extension to a linear map T : U ^ W (where as usual U 
denotes the closure of U in V ). Moreover |||T||| = HIT'IH- 

PROOF. Suppose v e U. Then there is a sequence Un & U such that Un v. Then Un 
is a Cauchy sequence, and since T is Lipschitz it follows that Tun is Cauchy in W, and 
since W is by assumption a Banach space (complete) it follows that Tun converges to a 
limit w e W, and we define Tv := w. We leave further details as an exercise. ■ 



> 7.1 — Exercise 3. If u'^ is a second sequence in U that converges to v show that Tu'^ 
has the same limit as Ttt„. (Hint: Consider the sequence ui,u[,U2,U2, . . . .) 

> 7.1 — Exercise 4. Why does |||T||| = |||T|||? 
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7.2 The Space B{[a,b],V) of Bounded Functions on V. 

7.2.1 Definition. Let V be a finite dimensional inner-product space and [a,b] C R a 
closed interval of real numbers. We denote by -B([a, 6], V) the vector space of all bounded 
functions a : [a, b] V, with pointwise vector operations, and we define a function a ^ 
Iklloo on B{[a,b],V) by = sup„<^<5 ||c7(t)||. 

> 7.2 — Exercise 1. Show that || ||^ really defines a norm for S([a, 6], V). 

Henceforth we shall always regard B{[a,b],V) as a metric space with the distance function 
defined by the norm || ||^. But what does convergence mean in this metric space? 

> 7.2 — Exercise 2. Let cr^ : [a, 6] — > F be a sequence in -B([a, 6], V) and a G -B([a, 6], V). 
To say that the sequence a"„ converges to a of course means by definition that the sequence 
of real numbers ||cn — cr|loo converges to zero. Show that this is the case if and only if the 
sequence of functions (Tn{t) converges uniformly to the function a{t) on the interval [a, b], 
i.e., if and only if for every e > there is a positive integer N such that the inequality 
||cn(0 — (^{'t)\\ holds for all t G [a, b] provided n > N. 

7.2.2 Remark. A similar proof shows that the sequence an is Cauchy in B{[a,b],V) if 
and only if the seqiience of functions o"j^(t) is uniformly Cauchy on [a,b], i.e., if and only 
if for every e > there is a positive integer such that the inequality ||o"^(t) — (7^(^)11 
holds for all t e [a, b] provided both m and n are greater than N. Now if (Tn{t) is uniformly 
Cauchy on [a, b], then a fortiori a^, is a Cauchy sequence in V for each t e [a, b], and since 
V is complete, an{t) converges to some element a{t) in V, and then it is easy to see that 
a is in B{[a, 6], V) and that cr — o"^ — 0. This proves that B{[a, 6], V) is a Banach space, 
i.e., any Cauchy sequence in B{[a, b], V) converges to an element of B{[a, b], V). 

7.3 Quick and Dirty Integration 

We will now see that it is quite easy to define the integral, f{t) dt, of a continuous map 
/ : [a, b] — > V, and in fact we shall define it for a class of / considerably more general than 
continuous. In all of the following we assume that F is a finite dimensional inner-product 
space. 

7.3.1 Definition. A partition U of [a, b] is a finite sequence a = to < ti < . . . < t„ = b, 
and we say that a function f : [a,b] ^ V is adjusted to the partition n if / is constant 
on each of the sub- intervals {ti,ti+i). We call / a step-function if there exists a partition 
to which it is adjusted, and we denote by «S([a, b],V) the set of all step functions. Clearly 
iS([o, b],V) C B{[a, b],V). If /i and /2 are two step-functions, and 11^ is a partition adjusted 
to fi, then any partition that contains all the points of Hi and 112 is adjusted to both fi 
and /2 and hence to any linear combination of them. This shows that S{[a,b],V) is a 
linear subspace of B([a, 

7.3.2 Definition. If f : [a,b] V is a step-function and if / is adjusted to a partition 
H = to < ti < . . . < tn, then we define its integral, I{f) G V, by := '^^^i{ti—ti-i)vi, 
where Vi is the constant value of / on the interval {ti-i,ti). 
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> 7.3 — Exercise 1. Show that the integral X : S{[a,b],V) — > y is a well-defined hnear 
map and satisfies ||X(/)[| < {b — a) \\f\\^, so that I is continuous and has norm |||X ||| = 
{b — a). Hint: The only (slightly) tricky point is to show that does not depend on 

the choice of a partition to which / is adjusted. Reduce this to showing that when you 
subdivide one subinterval of a partition, the integral does not change. 



We can now use our Extension Theorem For Continuous Linear Maps to conclude that X 
has a unique extension to a continuous linear map I : S{[a, b],V) V, where S{[a, b],V) 
denotes the closure of the step functions in the space B{[a,b],V) of bounded functions. 
For / G S{[a,b],V) we will also denote its integral, by f{t)dt, and we will refer 

to elements of S{[a,b],V) as integrable functions. Note that according to the extension 



theorem, the inequality 
function /. 



f{t) dt < (6 — a) ll/lloo continues to hold for any integrable 



7.3.3 Proposition. Integration commutes with linear maps. That is, if T : V W 
is hnear and f : [a,b] ^ V is integrable, then To/ : [a,b] —>■ W is integrable and 
T{Slf{t)dt) = jlT{f{t))dt. 

PROOF. The Proposition is obvious for step functions, and it then follows for integrable 
functions by the uniqueness of the extension. 



It is natural to wonder just how inclusive the space of integrable functions is. We note 
next that it contains all continuous functions. 

7.3.4 Proposition. The space C([a, 6], V) of continuous maps of [a, b] into V is a linear 
subspace of the space 5([a, 6], V) of integrable functions. 

PROOF. By a standard result of analysis, if / G C{[a,b],V) then / is uniformly con- 
tinuous. That is, given e > 0, there is a 5 > such that if ti and t2 are in [a, b] and 
1*1 — *2| < then — /(*2)|| < e- Choose an integer N so large that < 5 and 

partition [a, b] into N equal subintervals, and let be the step function that is constant 
on each subinterval of this partition and agrees with / at the left endpoint. Then clearly 
11/ — 011^ < e, proving that / is in the closure of S{[a, b],V) ■ 



> 7.3 — Exercise 2. The "standard result of analysis" says that, if X is a compact metric 
space then a continuous map / : X — > y is uniformly continuous. Prove this. Hint: One 
approach is to prove the "contrapositive" statement, i.e., show that if X is not uniformly 
continuous then there is at least one point x of X where / is not continuous. For this, 
pick an e so that for each integer n there are two points Xn and x'^ with p{xmx'^) < ^ 
but p{f{xn),f{x'^)) > e. By compactness, a subsequence x^^. converges to some point x. 
Show that a;' also converges to x and deduce that / is not continuous at x. 



7.3.5 Remark. The above proof generalizes to show that even a piecewise continuous 
f : [a,b] ^ V is integrable, where f : [a,b] ^ V is called piecewise continuous if there is a 
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partition of [a, b] such that / is continuous on each of its open subintervals, with a limit 
at each endpoint of the subinterval. 



> 7.3 — Exercise 3. Show that if f : [a,b] ^ V is integrable then jj^ f{t) dt 



la 11/(^)11 Hint: For a step function, this follows from the triangle inequality for norms. 
> 7.3 — Exercise 4. . Show that if / : [a, 6] — > y is integrable, and a < c < b, then 

Iaf{t)dt = j:f{t)dt + f^f{t)dt 



< 



> 7.3 — Exercise 5. Let / : [a, 6] — > F be continuous and define F : [a,b] — > F by 
F{t) := J^f{s) ds. Show that F is differentiable and that F' = /. 
Hint: i[F(to + h) - F(to)] - /(to) = ^ - /(^o)) ds. 

We next prove the vector version of the Fundamental Theorem of Integral Calculus (allow- 
ing us to evaluate a definite integral if we know an anti-derivative for the integrand) . As in 
the classic case it depends on knowing that only constant functions have a zero derivative. 

7.3.6 Lemma. If f : [a,b] ^ V is differentiable and f is identically zero, then f is 
constant. 

PROOF. This can be reduced to the classic special case that V = 11 (proved in elementary 
Calculus as an easy consequence of RoUc's Theorem). In fact, if £ E V* , then {£ o /)' = 
£ o /' = so (£ o /) is constant by the special case. But since this holds for every £ E V* 
it follows easily that / itself must be constant. ■ 



> 7.3 — Exercise 6. Prove the vector version of the Fundamental Theorem of Integral 

Calculus, That is, let / : [o, 6] — > V be continuous and let ^ : [a,b] ^ V be an antidcrivative 
of /, i.e., $ is difi'erentiable and $' = /. Show that f{t) dt = $(6) - $(a). Hint: If we 

define F{t) := f{s) ds, then we know F and $ have the same derivative, so F — $ has 
derivative 0, and by the lemma F and $ differ by a constant vector. 

7.3.7 Finite Difference Formula. Let O be a convex open set in V and let F : O ^ 

W be differentiable. If vo,vi e O, tlien F(vi) — F(vo) = DF^(^i-^(vi — vo)dt, wliere 
a{t) = vq + t{vi — vq), <t < 1 is the line segment joining vq to vi. 

PROOF. By the chain rule, {F o (j)'(t) = DF„^t){(y' [t]), and clearly a'{t) = vi - vq. 
Thus {F o a) is an anti-derivative for DF^i^-^^ivi — vq), and the result follows from the 
Fundamental Theorem. 



7.3.8 Corollary. Let O he a convex open set in V and let F : O ^ W be continuously 
differentiable. Then F satisfies a Lipschitz condition on any closed, bounded subset S of 
O. In fact, if K is an upper bound for \\ \ DFp \ \\ for p e S, then K is a Lipschitz bound 
forF. 

> 7.3 — Exercise 7. Use the Finite Difference Formula to prove the corollary. 
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7.4 Numerical Integration (or Quadrature Rules) 

Since one usually cannot find an anti-derivative for an integrand in closed form, it is 
important to be able to "evaluate an integral numerically" — meaning approximate it with 
arbitrary precision. In fact, this is so important that there are whole books devoted the 
study of numerical integration methods (aka quadrature rules). We will consider only two 
such methods, one known as the Trapezoidal Rule and the other as Simpson's Rule. In 
what follows, we will assume that the integrand / is always at least continuous, but for the 
error estimates that we will mention to be valid, we will need / to have several continuous 
derivatives. 



7.4.1 Definition. By a quadrature rule we mean a function M that assigns to each 
continuous function f : [a,b] ^ V (mapping a closed interval [a, b] into an inner-product 
space V) a vector M(/, a, b) G V — which is supposed to be an approximation of the 
integral, J f{t) dt. A particular quadrature rule M is usually given by specifying a linear 
combination of the values of / at certain points of he interval [a,b]; that is, it has the 
general form M{f,a,b) :— where the points ti G [a, 6] are called the nodes 
of M and the scalars Wi are called its weights. The error of M for a particular / and [a, b] 

is defined as Err(M, /, a, b) := f(t) dt - M{f, a, b) 

7.4— Example 1. The Trapezoidal Rule: M'^{f,a,b) := ^[/(a) + f{b)]. 
In this case, there are two nodes, namely the two endpoints of the interval, and they have 
equal weights, namely half the length of the interval. Later we shall see the origin of this 
rule (and explain its name). 

7.4— Example 2. Simpson's Rule: M^(/,a,6) := ^[/(a) +4/(^) + f{b)]. 

So now the nodes are the two endpoints, as before, and in addition the midpoint of the 

interval. And the weights are for the two endpoints and '^''^g ""-^ for the midpoint. 

7.4.2 Remark. Notice that in both examples the weights add up to 6 — a. This is no 

accident; any "reasonable" quadrature rule should have a zero error for a constant function, 
and this easily implies that the weights must add to b — a. 

7.4.3 Proposition. If f : [a,b] ^ V has two continuous derivatives, and \\f"{t)\\ < C 
for all t e [a, 6] then Ett(M'^ J,a,b) < C^^^. Similarly, if f : [a,b] V has four 
continuous derivatives, and ||/""(t)|| < C for all t e [a,b] then Err(M^,/, a,b) < C^^=^ 



7.4.4 Remark. The proof of this proposition is not difficult — it depends only the Mean 
Value Theorem — but it can be found in any numerical analysis text and will not be repeated 
here. 



7.4.5 Definition. If M is a quadrature rule then we define a sequence M„ of derived 
quadrature rules by M^if, a, b) := Yll=o -^(/^ a + ih,a + {i + l)h) where h = We 
say that the rule M is convergent for / on [a,b] if the sequence Mn{f,a,b) converges to 
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In other words, to estimate the integral f(t) dt using the n-th derived rule M„, we simply 
divide the interval [a, b] of integration into n equal sub-intervals, estimate the integral on 
each sub-interval using M, and then add these estimates to get the estimate of the integral 
on the whole interval. 

7.4.6 Remark. We next note an interesting relation between the errors of M and of M„. 

Namely, with the notation just used in the above definition, we see that by the additivity 
of the integral, f{t) dt = '^^^q Ja+ih^^^^ /(^) '^^^ hence from the definition of M„ and 
the triangle inequality, we have Err(M„, /, a, b) < X]r=o^ Err(M, f,a + ih,a + {i + l)h). We 
can now use this together with Proposition 7.4.3 to prove the following important result: 

7.4.7 Theorem. If / : [a, 6] — > F has two continuous derivatives, and \\f"{t)\\ < C for 
allt e [a, b] then Err(Mj, /, a, b) < C ^'^^^l . Similarly, if / : [a, 6] — > F has four continuous 
derivatives, and \\f""it)\\ < C for all t E [a,b] then ETT{M^J,a,b) < C^^^ 

> 7.4 — Exercise 1. Fill in the details of the proof of this theorem. 

7.4.8 Remark. This shows that both the Trapezoidal Rule and Simpson's Rule arc con- 
vergent for any reasonably smooth function. But it also shows that Simpson's Rule is far 
superior to the Trapezoidal Rule. For just fifty per cent more "effort" (measured by the 
number of evaluations of /) one gets a far more accurate result. 

Where did the formulas for the Trapezoidal Rule and Simpson's Rule come from? It helps 
to think of the classical case of a real- valued function /, so we can regard j^f{t)dt as 
representing the area under the graph of / between a and b. Now, if / is differentiable 
and the interval [a, b\ is short, then the graph of / is well- approximated by the straight 
line segment joining (a, (/(a)) to (6, f{b)), so the area under of the graph of / should be 
well-approximated by the area between the x-axis and this line segment. The latter area 
is of course a trapezoid (whence the name) and it has the area given by the Trapezoidal 
Rule formula. Simpson's Rule arises if instead of interpolating / by a linear function that 
agrees with / at o and b wc instead interpolate by a quadratic function cx^ + dx + e that 
agrees with / at a and b and also at the mid-point 

> 7.4 — Exercise 2. Using the method of "undetermined coefficients", show that there 
is a unique choice of coefficients c, d, e such that the quadratic polynomial cx^ + dx + e 
agrees with the function / at the three points a, b and . Find c, d, and e explicitly and 
integrate the polynomial from a to b, and check that this gives M^{f, a, b). 



7.5 Second Matlab Project. 

The second Matlab project is to develop Matlab code to implement the Trapezoidal Rule 
and Simpson's Rule, and then to do some experimentation with your software, checking 
that the error estimates of theorem 7.4.7 are satisfied for some test cases where the function 
/ has a known anti-derivative and so can be evaluated exactly. In more detail: 
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1) Write a Matlab function M-file defining a function TrapezoidalRule(f,a,b,n). This should 
return the value of M^{f,a,b). Here of course the parameters a and b represent real 
numbers and the parameter n a positive integer. But what about the parameter f, i.e., 
what should it be legal to substitute for f when the TrapezoidalRule(f,a,b,n) is called? 
Answer: f should represent a function of a real variable whose values are arrays (of 
some fixed size) of real numbers. The function that you are permitted to substitute for 
f should either be a built-in Matlab function (such as sin) or an inline function in the 
Matlab Workspace, or a function that is defined in some other M-File. 

2) Write a second Matlab function M-file defining a function SimpsonsRule(f,a,b,n) that 
returns M^{f^ a, h). 

3) Recall that -^^^2 = arctan(t), so that in particular t^§2 = 4arctan(l) = tt. Using 
the error estimates for the Trapezoidal Rule and Simpson's Rule, calculate how large n 
should be to calculate tt correct to d decimal places from this formula using Trapezoidal 
and Simpson. Set format long in Matlab and get the value of tt to fifteen decimal places 
by simply typing pi. Then use your Trapezoidal and Simpson functions from parts 1) 
and 2) to see how large you actually have to choose n to calculate tt to 5, 10, and 15 
decimal places. 

4) Be prepared to discuss your solutions in the Computer Lab. 
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Lecture 8 

Ordinary Differential Equations (aka ODE) 



8.1 The Initial Value Problem for an ODE. 

Suppose we know the wind velocity at every point of space and at every instant of time. 
A puff of smoke drifts by, and at a certain moment we observe the precise location of a 
particular smoke particle. Can we then predict where that particle will be at all future 
times? By making this metaphorical question precise we will be led to the concept of an 
initial value problem for an ordinary differential equation. 

We will interpret "space" to mean R"^, or more generally an inner- product space V, and 
an "instant of time" will be represented by a real number t. Thus, knowing the wind 
velocity at every point of space and at all instants of time means that we have a function 
X : V X a. ^ V that associates to each {v,t) in V x H, a vector X{v,t) in V representing 
the wind velocity at v at time t. Such a mapping is called a time- dependent vector field 
on V. We will always be working with such X that are at least continuous, and usually 
X will even be continuously differ entiable. In case X{v,t) does not actually depend on t 
then we call X a time-independent vector field on V, or simply a vector field on V. Note 
that this is the same as giving a map X : V V. 

How should we model the path taken by the smoke particle? An ideal smoke particle is 
characterized by the fact that it "goes with the flow", i.e., it is carried along by the wind, 
meaning that if x{t) is its location at a time t, then its velocity at time t will be the wind 
velocity at that point and time, namely X{x{t),t). But the velocity of the particle at time 
t is x'{t) = so the path of a smoke particle will be a differentiable curve x : {a,b) ^ V 
such that x'{t) = X{x{t),t) for all t G (a, 6). Such a curve is called a solution curve of 
the time-dependent vector field X and we also say that "x satisfies the ordinary differential 
equation ^ = X{x,t)" . 

Usually we will be interested in solution curves of a differential equation ^ = X{x, t) that 
satisfy a particular initial condition. This means that we have singled out some special 
time to (often, to = 0), and some specific point vq G V, and we look for a solution of 
the ODE that satisfies x{to) = vo- (In our smoke particle metaphor, this corresponds to 
observing the particle at vq as our clock reads to.) The pair of equations ^ = X{x.,t) and 
x{to) = Vo is called an "initial value problem" (abbreviated as IVP) for the ODE ^ = X. 
The reason that it is so important is that the so-called Existence and Uniqueness Theorem 
for ODE says (more or less) that, under reasonable assumptions on X, the initial value 
problem has a "unique" solution. 

8.1.1 Remark. If the vector field X is time-independent, then the ODE — X is often 
called autonomous. 

8.1.2 Remark. In the case V = R"^, X{x,t) = (Xi(x, t), . . . , X„(x, t)) so that written 
out in fuU, the ODE = ^ looks like ^ = Xi{xi{t), . . . ,Xn{t),t), i ^ 1, . . .n. In this 
form it is usually referred to as a "system of ordinary differential equations" . 
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8.1 — Example 1. X a constant vector field, i. e., X{v,t) = u, where u is some fixed 
element of V. The solution with initial condition x{to) = vq is clearly the straight line 
x{t) := vo + {t- to)u. 

8.1 — Example 2. X is the "identity" vector field, X{v,t) = v. The solution with initial 
condition x{to) = vq is clearly x{t) := e^^~^°^vo. (Later we will see how to generalize this 
to an arbitrary linear vector field, i.e., one of the form X{v, t) = Tv where T : V ^ V is a, 
continuous linear map.) 

8.1 — Example 3. A vector field that is "space- independent" , i. e., X{v,t) = f{t) where 
/ : R ^ y is continuous. The solution with initial condition x{to) = vq is x{t) = 

^0 + II /(«) ds- 

8.2 The Local Existence and Uniqueness Theorem. 

In what follows, X : V x R ^ V is a time dependent vector field on V , vq E V , I = [a, b] 
is an interval of real numbers, and to ^ I- We define a map F — of C(/, V) to itself 

by: F{a){t) := Vo + X{a{s), s) ds. 

The following proposition follows immediately from the definitions and the Fundamental 
Theorem of Integral Calculus. 

Proposition. A necessary and sufficient condition for a : I ^ V to be a solution of the 
initial value problem — X{x,t) and x{to) — vq is tliat a be a fixed point of F^^^^. 

This immediately suggests using successive approximations as a strategy for solving the 
initial value problem. Start say with the constant curve xq : I V given by Xo{t) = Vq, 
and define x^ ■ I ^ V inductively by Xn+i := -F^^^^^(x„), and attempt to show that Xn 
converges to a fixed point of F^ perhaps by showing that the Contraction Principle 
applies. As we shall now see, this simple idea actually works for a very general class of 
ODE. 

> 8.2 — Exercise 1. Carry out the above strategy for the case of the time- independent 
vector field X{v) := v with to = 0. We saw above that the solution in this case is 
x{t) = e^VQ. Show by induction that Xn{t) = Pn{t)vo, where Pn is the n-th order Taylor 
polynomial for e*, i.e., Pn{t) = Ylk=o M- 

Local Existence and Uniqueness Theorem For ODE. Let X : V x ^ V be a 

time-dependent vector field onV,pE V , and to e R. Tliere are positive constants e and 
S depending on X, p, and to such that if I = [to — S,to + S], then for each vo & V with 
Iko ~ p\\ < e the differential equation o'it) = X{a{t),t) has a unique solution a : I ^ V 
satisfying a (to) — vo- 

PROOF. If e > 0, then using the technique explained earlier we can find a Lipschitz 
constant M for X restricted to the set of {x,t) G x R such that — p|| < 2e and 
1^ — ^o| ^ Let B be the maximum value of on this same set, and choose 6 > 

so that K — MS < 1 and Bd < e, and define Y to be the set of a in C(/, V) such that 
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||cr(t) — p\\ < 2e for all \t\ < 6. It is easy to see that Y is closed in C{I, V), hence a complete 
metric space. The theorem will follow from the Banach Contraction Principle if we can 
show that for ||fo|| < e, F = F^.^,^ maps Y to itself and has as a Lipschitz bound. 

IfaeY then \\F{a){t) - p\\ < \\vo - p\\ + \\X{a{s), s)\\ ds<e + 5B < 2e, so F maps Y 
to itself. And if (71, 0-2 e X then \\X{ai{t),t) - X{a2{t),t)\\ < M ||cri(t) - cr2(t)||, so 

||F(ai)(t)-F(a2)(t)||< / - X(a2(s), ds 

Jo 

< I M||c7i(s) -C72(s)|| ds 
Jo 

< / Mp{ai,a2)ds 
Jo 

< 6Mp{ai,a2) < Kp{ai,a2). 
and it follows that p{F{ai), F{a2) < Kp{ai,a2)- ■ 



> 8.2 — Exercise 2. Show that continuity of V is not sufficient to guarantee uniqueness 
for an I VP. Hint: The classic example (with F = R) is the initial value problem ^ = ^/x, 
and x{0) = 0. (Note that this is C^, except at the point x = 0.) Show that for each 
T > 0, we get a distinct solution x^{t) of this IVP by defining Xj,{t) = for t < T and 
x^{t) = |(t-T)2 fort >r. 

8.2.1 Remark. The existence and uniqueness theorems tell us that for a given initial 
condition we can solve our initial value problem (uniquely) for a short time interval. The 
next question we will take up is for just how long we can "follow a smoke particle". You 
might guess for each initial condition p in V we should have a solution Xp : Ti ^ V 
with Xp{to) = p. But such global in time existence is too much to expect in general. 
For example, take V = R and consider the differential equation — x"^ with the initial 
condition x{0) — xq. An easy calculation shows that the unique solution is x{t) — j^f^- 
Note that xq, this solution "blows up" at time T = and by the uniqueness theorem, 
no solution can exist for a time greater than T. 

You may object that a particle of smoke will never go off to infinity in a finite amount 
of time! Perhaps the smoke metaphor isn't so good after all. The answer is that a real, 
physical wind field has bounded velocity, and it isn't hard to show that in this case we do 
indeed have global in time existence. 

We are now going to make a simplification, and restrict attention to time-independent 

vector fields (which we shall simply call vector fields) . That may sound like a tremendous 
loss of generality, but in fact it is no loss of generality at all! 

> 8.2 — Exercise 3. Let X{v,t) be a time-dependent vector field in V, and define an 
associated time independent vector field X in F x R by X{y) = {X{y),l). Show that 
y{t) = {x{t), f{t)) is a solution of the differential equation ^ = X{y) if and only if 
f{t) = t + c and x{t) is a solution of ^ = X{x,t + c). Deduce that if y{t) = (x(t), f{t)) 
solves the IVP ^ = ^{v): 2/(^o) = {xo,to), then x(t) solves ^ = X{x,t), x{to) — xq. 
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This may seem like a swindle — we don't seem to have done much beyond coalescing the 
original time variable t with the space variables, i.e., we have switched from a space + time 
description to a space-time description. But there is another important difference, namely 
X takes values in F x R. In any case, this is a true reduction of the non-autonomous case 
to the autonomous case, and it is important, since autonomous differential equations have 
special properties that make them easier to study. Here is one such special property of 
autonomous systems. 

8.2.2 Proposition. If x : {a,b) ^ V is any solution of the autonomous differentiable 
equation = X{x) and to G R, then y : {a + to,b + to) ^ V defined by y{t) = x{t — to) 
is also a solution of the same equation. 

> 8.2 — Exercise 4. Prove the above Proposition. 

Consequently, when considering the IVP for an autonomous differentiable equation we can 
assume that to = 0. For if x{t) is a solution with x{0) = p, then x{t — to) will be a solution 
with x{to) = p. 

8.2.3 Remark. There is another trick that allows us to reduce the study of higher order 
differential equations to the case of first order equations. Consider the second order differ- 
ential equation: ^ = f(x, ^,t). Introduce a new variable v, (the velocity) and consider 
the following related system of first order equations: ^ = v and ^ — f{x,v,t). It is pretty 
obvious there is a close relation between curves x{t) satisfying = f{x{t),x'{t),t) and 
pairs of curves x{t), v{t) satisfying x'{t) — v{t) and v'{t) — f{x{t),v{t),t). 

> 8.2 — Exercise 5. Define the notion of an initial value problem for the above second 
order differential equation, and write a careful statement of the relation between solutions 
of this initial value problem and the initial value problem for the related system of first 
order differential equations. 

We will now look more closely at the uniqueness question for solutions of an initial value 
problem. The answer is summed up succinctly in the following result. 

8.2.4 Maximal Solution Theorem. Let ^ = X{x) be an autonomous differential 
equation in V and p any point ofV. Among all solutions x{t) of the equation that satisfy 
the initial condition x{0) = p, there is a maximum one, CTp, in the sense that any solution 
of this IVP is the restriction of ap to some interval containing zero. 

> 8.2 — Exercise 6. If you know about connectedness you should be able to prove this 
very easily. First, using the local uniqueness theorem, show that any two solutions agree 
on the intersection of their domains. Then define Up to be the union of all solutions. 

Henceforth whenever we are considering some autonomous differential equation, ap will 
denote this maximal solution ciuve with initial condition p. The interval on which ap is 
defined will be denoted by {a{p),u){p)), where of course a(p) is either — oo or a negative 
real number, and Lo{p) is either oo or a positive real number. 
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We have seen that the maximal solution need not be defined on all of R, and it is important 
to know just how the solution "blows up" as t approaches a finite cndpoint of its interval of 
definition. A priori it might seem that the solution could remain in some bounded region, 
but it is an important fact that this is impossible — if uj{p) is finite then the reason the 
solution cannot be continued past u){p) is simply that a{t) escapes to infinity (in the sense 
that ||crp(t)|| — > oo) as t approaches u>ip). 

8.2.5 No Bounded Escape Theorem. If uj{p) < oo then lim^^^f^p^ — oo? 
similarly, if a(p) > — oo then limf^a(p) l|c"p(^)|| — oo. 

> 8.2 — Exercise 7. Prove the No Bounded Escape Theorem. 

(Hint: If lim^^^^^) ||c"(p)|| oo, then by Bolzano- Weierstrass there would be a sequence tk 
converging to a;(p) from below, such that ap{tk) — > q- Then use the local existence theorem 
around g to show that you could extend the solution beyond uj{j>). Here is where we get 
to use the fact there is a neighborhood O oi q such that a solution exists with any initial 
condition q' in O and defined on the whole interval (— e, e). For k sufficiently large, we 
will have both ap{tk) in O and tk > uj — e, which quickly leads to a contradiction.) 

Here is another interesting and important special properties of autonomous systems. 

> 8.2 — Exercise 8. Show that the images of the ap partition V into disjoint smooth 
curves (the "streamlines" of smoke particles). These curves are referred to as the orbits of 
the ODE. (Hint: If x{t) and ^{t) are two solutions of the same autonomous ODE and if 
^(*o) = ^(^i) then show that x{to + s) = ^{ti + s).) 

> 8.2 — Exercise 9. Show that if the vector field X : V ^ V is C'' then each maximal 
solution cjp : (ctp, ujp) — > F is C'^'^^. (Hint: To begin with we know that ap is differentiable 
and hence continuous, so t i— > X{ap{t)) is at least continuous. Now use the relation 
cr'p{t) = X{ap{t)) to argue by induction.) 

8.2.6 Remark. In the next section we will discuss the smoothness of (Jp{t) as a function 
of p and t jointly, and see that it is of class C^. 

8.2.7 Definition. A C'' vector field X : V ^ V (and also the autonomous differential 
equation ^ = X{x)) is called complete if a{p) = — oo and uj{p) = oo for all p in V. In this 
case, for each t G R we define a map (pt '■ V ~> V hy (pt{p) = (^p{t)- The mapping t ^ (j)t 
is called the flow generated by the differential equation ^ = X{x). 

8.2.8 Remark. Using our smoke particle metaphor, the meaning of (/>t can be explained 
as follows: if a puff of smoke occupies a region [/ at a given time, then t units of time later 
it will occupy the region (f)t{U). Note that 0o is clearly the identity mapping of R"^ 

> 8.2 — Exercise 10. Show that the 0^ satisfy (f)ti+t2 = 0ti0t2J so that in particular 
(f)-t — (t>i^ ■ By the next section, each 0^ is actually a "diffeomorphism" of V , i.e., both it 
and its inverse are C^. So the fiow generated by a complete, autonomous vector field is 
a homomorphism of the additive group of real numbers into the group of diffeomorphisms 
oiV. 
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8.3 Smoothness of Solutions of ODE. 

As we saw above, it is an easy exercise to show that each solution of the differential 
equation ^ = X{x) will be (7^+^ if X is C'^. But in practice it is also important to 
know how solutions of an ODE depend on initial conditions. Also, if we have a family of 
X{x, a) of vector fields depending on some parameters a — {ai, . . . , cufe) e R'^, we would 
like to know how the solutions of the corresponding IVP depend on these parameters. The 
following theorem answers all these questions. We will not give the proof here. It can 
be found in any good textbook on ODE. (One excellent source is Differential Equations, 
Dynamical Systems, and Linear Algebra by Morris Hirsch and Stephen Smale. See in 
particular Chapter 15.) 

Theorem. Let X : V x b!" ^ V he a map. We regard X{x, a) as a family of vector 
fields on V depending on the parameter a G R'^, and denote by t ^ cr^ (t) the maximal 
solution of the ODE = X{x,a) with (7^(0) = p. Then the map {p,t,a) i-^ o-p{t) is of 
class C^. 
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Lecture 9 

Linear ODE and Numerical Methods 



9.1 Linear Differential Equations. 

If A : V — V is a continuous linear operator on V then we can also consider A as a vector 

dx 
dt 



field on V. The corresponding autonomous ODE, jnr = Ax is called a linear differential 



equation on V. 

Denote by C(R, y) the continuous maps of R into and let F = F^^^ be the map 
of C(R, y) to itself defined by F{x){t) := xq + A{x{s)) ds. Since A is Hnear, this 

can also be written as F{x){t) :— xq + A x{s) ds. We know that the solution of the 
IVP with initial value xq is just the unique fixed point of F, so let's try to find it by 
successive approximations starting from the constant path x^{t) = xq. If we recall that 
the sequence of successive approximations, x"", is defined recursively by x"""*"^ = F{x'^), 
then an elementary induction gives = X]fc=o ^M^Y'^o^ suggesting that the solution 

to the initial value problem should be given by the limit of this sequence, namely the 
infinite series YlT=o 't\i^^)^^'^- ■'^^^ (^^^ obvious reasons) given a linear operator T acting 
on y, the limit of the infinite series of operators XlfcLo h"^^ denoted by or exp(T) so 
we can also say that the solution to our IVP should be e*'^XQ. 

The convergence properties of the series for e^x follow easily from the Weierstrass M-test. 
If we define = -j^lH T |||^r, then converges to e'll'^lllr, and since H^T'^xH < M/- 

when < r, it follows that Y1T=q W.'^^'^ converges absolutely and uniformly to a limit, 
e'^x, on any bounded subset of V. 

t> 9.1 — Exercise 1. Provide the details for the last statement. 

(Hint: Since the sequence of partial sums J2^=o^k converges, it is Cauchy, i.e., given 
e > 0, we can choose N large enough that Y.Z^'' Mk < e provided m > N. Now if 



\x\\ < r, 



Y.T=o Ja'^''^ ^ YlT=o h."^^^ < Sm'^'' < e, proving that the infinite series 
defining e^x is uniformly Cauchy and hence uniformly convergent in < r.) 

Since the partial sums of the series for e^x are linear in so is their limit, so is indeed 
a linear operator on V . 

Next observe that since a power series in t can be differentiated term by term, it follows 
that ^e*^xo = Ae^^xo, i.e., x{t) — e^^xo is a solution of the ODE ^ = Ax. Finally, 
substituting zero for t in the power series gives c^^xq = xq. This completes the proof of 
the following proposition. 

9.1.1 Proposition. If A is a linear operator on V then the solution of the linear 
differential equation ^ = Ax with initial condition xq is x{t) = e^^XQ. 

As a by-product of the above discussion we see that a linear ODE ^ = Ax is complete, 
and the associated fiow <pt is just e*"^. By a general fact about fiows it follows that 
^{s+t)A _ ^sA^tA^ g^j^j g-A _ : ^ i—i^ e"^ is a map of the vector space L{V) 
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of all linear maps of V into the group GL{V) of invertible elements of L{V) and for each 
A e L{V), 1 1— > e^^ is a homomorphism of the additive group of real numbers into GL(y). 

t> 9.1 — Exercise 2. Show more generally that if A and B are commuting linear operators 
on V then e"^"*"^ = e^e^ . (Hint: Since A and B commute, the Binomial Theorem is valid 
for (A + S)^, and since the series defining e^~^^ is absolutely convergent, it is permissible 
to rearrange terms in the infinite sum. For a different proof, show that e^^e^^xo satisfies 
the initial value problem = {A + B)x^ x{Q) — xq, and use the uniqueness theorem.) 

> 9.1 — Exercise 3. Now assume that y is a finite dimensional inner-product space. 
Show that (e^)* = e^*. (Hint: Recall that {ABf = B* A* .) Show that if A is skew- 
adjoint (meaning A* = —A) than is in the orthogonal group. Conversely show that if 
e^"^ is in the orthogonal group for alH e R then A must be skew-adjoint. 

> 9.1 — Exercise 4. Let's say that A e L(y) is tangent to the orthogonal group 0{V) 
at the identity if there is a differentiable path a : (a, b) — > L{V) defined near 0, such that 
a{t) e 0{V) for all t, cr(0) = /, and cr'(O) = A. From what we have just seen, every 
skew-adjoint A is tangent to 0{V) at /. Show that conversely any A that is tangent to 
0{V) at / must be skew-adjoint. (Hint: Differentiate the identity a{t)a{t)* = / at t = 0.) 



9.2 Numerical Solutions of ODE. 

Once we go beyond the linear case, only a few rather special initial value problems can 
be solved in closed form using standard elementary functions. For the general case it is 
necessary to fall back on constructing a solution numerically. But what algorithm should 
we use? A natural first guess is successive approximations. But while that is a powerful 
theoretical tool for studying general properties of initial value problems — and in particular 
for proving existence and uniqueness — it turns out to be so inefficient as an approach to 
calculating numerical solutions, that it is rarely used. 

In fact there is no unique answer to the question of what numerical algorithm to use 
for solving ODEs, for there is no one method that is "best" in all situations. There are 
integration routines that are fast and accurate when used with the majority of equations 
one meets. Perhaps the most popular of these is the fourth order Runge-Kutta algorithm 
(which we will consider below). But there are many special situations that require a more 
sophisticated approach. Indeed, this is still a very active area of research, and there are 
literally dozens of books on the subject. 

The initial goal will be to give you a quick first impression of how numerical methods work 
by describing one of the oldest numerical approaches to solving an initial value problem, 
the so-called "Euler Method" . While rarely a good choice for practical computation, it is 
intuitive, simple, and effective, and it is also the basis for some of the more sophisticated 
algorithms. This makes it an excellent place to become familiar with the basic concepts 
that enter into the numerical integration of ODE. 
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In what follows we will suppose that X is a C time-dependent vector field on V, and 
given to in R- and in V we will denote by a{X,x^ ,to,t) the maximal solution, x{t), of 
the differential equation ^ = X{x,t) satisfying the initial condition x{to) = x^. The goal 
in the numerical integration of ODE is to devise effective methods for approximating x{t) 
on an interval / = [to 2^]- The strategy that many methods use is to interpolate N equally 
spaced gridpoints ti,. . .t^ in the interval /, defined by '■= to + kAt with At = , 
and then use some rule to define values x^, . . . , x^ in V, in such a way that when is 
large each x'^ is close to the corresponding x{tk)- The quantity maxi<fc<Ar ||a:^ — ic(tfc)|| is 
called the global error of the algorithm, and if it converges to zero as tends to infinity 
(for every choice of X, to, a;°, and T), then we say that we have a convergent algorithm. 
Euler's Method is a convergent algorithm of this sort. 

One common way to construct the algorithm that produces the values x^, . . . ,x^ uses a 
recursion based on a so-called "stepping procedure", namely a function, 'E{X,x^,to, At), 
having as inputs: 

1) a time-dependent vector field X on V, 

2) an initial condition x^ in V, 

3) an initial time to in R, and 

4) a "time-step" At in R, 

and with output a point of V that for small At approximates a{X,x^,to,to + At) well. 
More precisely, the so-called "local truncation error" , defined by 

\\a{X, a;°, to, + At) - S(X, x^, to, At)\\ , 

should approach zero at least quadratically in the time-step At. Given such a step- 
ping procedure, the approximations x'^ of the x{tk) are defined recursively by x^~^^ = 
'E{X, x'',tk, At). Numerical integration methods that follow this general pattern are re- 
ferred to as finite difference methods. 

9.2.1 Remark. There are two sources that contribute to the global error, ^^x'^ — a:(tA;)||. 
First, each stage of the recursion will give an additional local truncation error added to 
what has already accumulated up to that point. But, in addition, after the first step, 
there will be an error because the recursion uses x^,tk. At) rather than the unknown 
E(X, x{tk),tk, At). (In practice there is a third source of error, namely machine round-off 
error from using floating-point arithmetic. We will usually ignore this and pretend that our 
computers do precise real number arithmetic, but there are situations where it is important 
to take it into consideration.) 

For Euler's Method the stepping procedure is simple and natural. It is defined by: 
Euler Step 

E^(X,a;°,to, At) := x^ + AtX(x^,to). 
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It is easy to see why this is a good choice. If as above we denote a{X,x^,to,t), by x{t), 
then by Taylor's Theorem, 

x{to + At) =x{to) + Atx'{to) + O(At^) 

= x^ + AtX{x^,to) + 0{At^) 

= S^(X, a;°, to, At) + O(At^), 

so \\a{X,x^,to,to + At) — T,{X, x^ ,to, At)\\, the local truncation error for Euler's Method, 
does go to zero quadratically in At. When we partition [0, T] into N equal parts. At = 
, each step in the recursion for computing x'^ will contribute a local truncation error 
that is O(At^) = 0{-^). Since there are steps in the recursion and at each step we add 
0{-^) to the error, this suggests that the global error will be and hence will go to 

zero as tends to infinity. However, because of the remark above, this is not a complete 
proof that Euler's Method is convergent, and we will not give the details of the rigorous 
argument. 

> 9.2 — Exercise 1. Show that Euler's Method applied to the initial value problem 
f = a; with a;(0) = 1 gives limAr->oo(l + = e*. 

Two positive features of Euler's method are it's intuitiveness and the ease with which it 
can be programmed. Beyond that there is little to recommend it as a practical method 
for solving real- world problems. It requires very small time steps to get reasonable accu- 
racy, making it too slow for serious applications, and in fact it is rarely used except for 
pedagogical purposes. 

On the other hand, as we have already said, there is one excellent general purpose finite 
difference method for solving IVPs, and it goes by the name Runge-Kutta — or more prop- 
erly the fourth order Runge-Kutta Method — since there is a whole family of Runge-Kutta 
methods. The stepping procedure for fourth order Runge-Kutta is: 

Runge-Kutta Step 

E^^' {X, xo, to, At) := xo + lih + 2/c2 + 2/c3 + /C4), where: 

ki = AtX{xo,to) 

k2 = AtX{xo+\ki,to + ^) 

k3 = AtX{xo+lk2,to + f) 

k4 = AtX{xo + ks,to + At) 

It is of course natural to ask where this formula comes from. But if you recall Simpson's 
Rule then the above should not look all that unreasonable, and indeed if f{x,t) — (j){t) 
then recall that the solution of the IVP reduces to the integral of (f) and in this case the 
Runge-Kutta formula reduces precisely to Simpson's Rule. But even better, like Simpson's 
Rule, Runge-Kutta is fourth order, meaning that the local truncation error goes to zero 
as the fifth power of the step-size, and the global error as the fourth power. So if for a 
fixed step-size we have attained an accuracy of 0.1, then with one-tenth the step-size (and 
so ten times the number of steps and ten times the time) we can expect an accuracy of 
0.00001, whereas with the Euler method, ten times the time would only increase accuracy 
from 0.1 to 0.01. 
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> 9.2 — Exercise 2. Write a Matlab M-File function Euler (X , xO , T , n) that estimates 
x{T), the solution at time T of the initial value problem ^ = X{x), x(0) = xO by applying 
the Euler stepping method to the interval [0, T] with n time steps. Similarly write such 
a function RmigeKutta(X,xO,T,n) that uses the Runge-Kutta stepping method. Make 
some experiments using the case F = R, ^ = x with xO = 1 and T = 1, so that x{T) = e. 
Check how large n has to be to get various degrees of accuracy using the two methods. 



40 



Math 32a Fall 2003 



R. Palais 



Lecture 10 

The Theorem of Frobenius 



10.1 What if Time were Two-dimensional? 

With our study of ODE, we have completed the review of the analytical tools that will be 
required for our study curve theory. However, when we turn later to the study of surfaces, 
there is an additional tool we will need. This is embodied in a theorem of Frobenius that 
we consider next. 

One approach to the Frobenius Theorem is consider what would become of the local 
existence and uniqueness theorem for the IVP for ODE if "time" , instead of being one- 
dimensional, was two-dimensional. That is, suppose that an instant of time is represented 
not by a single real number t G R, but by an ordered pair (^1,^2) of real numbers. (We 
still assume that "space" is represented by points of a vector space, V, although shortly 
we will specialize to the case V — R".) What is the natural generalization of an ODE and 
its associated initial value problem? 

The history of a smoke particle — that is, a particle that streams along with the wind — will 
now be described not by a "world-line" t ^ x{t) from R to y but by a "world-sheet" 
(^1,^2) ^ ^2), a map from our pair of "time" parameters in R^ to V. And since their 
are now two time coordinates, the particle will have not one but rather two velocity vectors 
associated to it at time (^1,^2), namely ^'^^glf'^^ and Thus the "wind" must now 

be described not by a single time-dependent vector field X : V x R ^ V, but by a pair 
of time-dependent vector fields : V x R^ V and X'^ : V x R^ V. Operationally, 
the definition of X'^{v,ti,t2) is as follows: place a smoke particle at v, and at time (^1,^2) 
let it go, and measure its velocity ^2i^iiM_ ^11 that follows we will assume that these 
vector fields and X^ axe C'^, k>2. 

The ordinary differential equation IVP — X{x,t), x{t^) — describing a smoke particle 
motion when time is one-dimensional is now replaced by a similar IVP for a "system of 
first order partial differential equations" : 

1) x{t'i,4)=v', 
(*) 2) — = X\x,t,,h), 

dec 

3) ^^=X\x,ti,t2), 

An Algorithm for Constructing Solutions of the System (*). 

We now describe a simple and intuitive algorithm that we will refer to as Algorithm F for 
constructing the solution x{ti,t2) of the initial value problem (*) near (^1,^2) = (^17^2)5 
provided a solution exists. To be more precise, the algorithm will produce a map (^1,^2) ^ 
x(ti,t2), defined for (^1,^2) in a neighborhood U of (^1,^2) defined by \ti — t1\ < e, i = 1,2, 
and for which the following five statements a) to e) are valid: 
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a) x{ti,t2) satisfies the initial value condition 1) of (*), 

b) x{ti,t2) satisfies 2) of (*), at least along the line t2 = 

c) x{ti,t2) satisfies 3) of (*) in all of U, 

d) X :U is C'', 

e) The properties a), b), c) uniquely determine the function x{ti,t2) near (4,4), hence it 
will be the unique solution of (*) near (t^^t^), if any solution exists. 

The strategy behind Algorithm F comes from a subtle change in point of view. Instead of 
regarding 2) and 3) of (*) as a pair of coupled PDE with independent variables ti and 
we consider them as two independent ODEs, the first with ti as independent variable and 
t2 as parameter, and the second with these roles reversed. 

Algorithm F is defined as follows. First we solve the ODE initial value problem ^ = Y(y, t) 
and y{ti) = v^, where Y{v,t) := X^{v,t,t2)- By the local existence and uniqueness 
theorem for ODE, if e is sufficiently small then the solution will exist for |t — t?] < e, and 
moreover y{t) will be C'^'^^. We now define x{ti,t'^) = y{ti) for \ti - t\\ < e. This of 
course guarantees that no matter how we define (^1,^2) for other values of t2, statements 
a) and b) will be valid. Moreover, by the uniqueness of solutions of the IVP for ODEs, it 
is clear that conversely if a) and b) are to hold then we must define x{ti,t2) this way on 
\ti < e. 

Next we consider the ODE ^ — Z{z,t,ti) where ti is considered a parameter and the 
vector field Z is defined by Z{v,t,ti) :— X'^{v,ti,t). It again follows from the local 
existence and uniqueness theorem for ODE that if e is sufficiently small, then for each ti 
with \ti — ti\ < e, the IVP = Z{z,t,ti), -2(^2) = y(^i) = 3:^(^17^2) has a unique solution 
Zt^it) for \t — < e. We now define x(ti,t2) in U by x{ti^t2) — -2*1(^2)- We note that 
because of the initial condition 2(^2) = uiti) = ^{^11^2)^ ^^^^ extends the definition of 
x(ti,t2) in the first part of the algorithm, so properties a) and b) still hold. But now in 
addition, c) also clearly holds, and moreover in order for c) to hold then by the uniqueness 
theorem for ODE the way we extended the definition of x(ti,t2) to all of U was the only 
way possible; in other words property e) is established. Finally, property d) is immediate 
from the Theorem of Section 8.3 (concerning the smoothness of solutions of ODE with 
respect to initial conditions and parameters). 

[That completes the formal description of Algorithm F. We now restate it in less formal 
and more intuitive language. First find x{ti^ ^2) along the line t2 — ^2 by freezing the value 
of t2 at t2 and regarding the partial differential equation ^ = X^{x,ti,t2) as an ODE 
in which t2 is just a parameter. Then, regard the PDE ^ = X^(a;,ti,t2) as an ODE in 
which t\ is a parameter, and for each parameter value ti near t\ solve this ODE, taking 
for initial value at t2 = ^2 the value x{ti,t2), found in the first step.] 

The question we will consider next is under what conditions the function x{ti,t2) defined 
by Algorithm F satisfies equation 2) of the system (*) in all of U, and not just along the 
segment ti = 
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First we look at a couple of examples. 

10.1 — Example 1. Take V — and define X^{x,ti,t2) — X^(a;,ti,t2) — x, so the 
system of PDE is ^ = ^ = a;. In this case Algorithm F leads to the function x(ti,t2) = 
yO Q(ti-t°) ^(t2-t°) y^Y^iojr^ clearly does solve the system (*). 

10.1 — Example 2. Let V = Ti, define X^{x,ti,t2) = x, X^(x,ti,t2) = 1 and take as 
initial condition a;(0,0) = 1. Now the system of partial diff'crential equations is ^ = x 

and ^ = 1. Applying Algorithm F, the first equation together with the initial condition 
gives x{ti, 0) = and the second equation then implies that x{ti,t2) — 6*^ + ^2- In this 
case the first of the two partial difi^erential equations is clearly not satisfied off the line 

t2 = 0\ 

So we see life is not going to be quite as simple as with one-dimensional time. For certain 
choices of and X'^ it will be possible to solve the IVP locally for every choice of initial 
condition ^2) = while for other X^ and X^ this will not be so. Let's give a name 
to distinguish between these cases. 

10.1.1 Definition. Let X^ : V x ^ V and X'^ : V x ^ V be maps. We 

call the system of PDEs ^ = X^{x,ti,t2) and ^ = X'^{x,ti,t2) is integrable, if for 
every (^1,^2) ^ and G V, their is a solution x of this system that is defined in a 
neighborhood of (^1,^2) and that satisfies the initial condition a;(/;(t°, ta)) = v'^ 

What the Frobenius Theorem does is provide a necessary and sufficient condition for a 
system to be integrable. Moreover, this condition is both natural and easy and practical 
to apply. Since it becomes somewhat easier to formulate in the case that V = R"^, we will 
assume we are in that case from now on. (Of course this is no real loss of generality, since 
it simply amounts to choosing a basis for V.) 

The vector fields X^ and X'^ can now be described by 2n C'^ real- valued functions Xj and 
X| on X R^: 

X''{x,ti,t2) = X^Xi, . . .,Xn,ti,t2) = {Xl{xi, . . .,Xn,ti,t2), ■ ■ . ,X^(a;i, . . .,Xn,ti,t2)) 

10.1.2 Definition. Let : R'' x R^ ^ R"" and X^ : R'^ x R^ ^ R'^ be vector fields 
on R" depending on two real parameters ti and ^2- We will call X^ and X^ compatible if 
the following n conditions hold identically: 




1 < z < n. 



Frobenius Theorem. If X^ : R"" x R^ ^ R'" z = 1, 2 are two vector Gelds on R", 
then the system of PDEs ^ = X^{x,ti,t2) and ^ = X'^{x,ti,t2) is integrable if and 
only if X^ and X^ are compatible. 
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PROOF. We first check the necessity of the condition. We assume the system is integrable 
and show that the compatibility identities hold at an arbitrary point {x^, ^17^2) ^ ^ ■ 
Let x{ti,t2) be a solution of = ti, ^2), i = 1,2 defined near (^1,^2) ^^'^ satisfying 

x{{ti,t2)) = x^. From d) and e) above we know that x is C^, so in particular its second 
cross partial-derivatives at (a;°,t5:^2) exist and are equal. If we differentiate the equation 
dxi{ti,t2) _ xl{x{ti,t2),ti,t2) with respect to t2, using the chain-rule, we find: 



d dx{ti,t2) 



dXl{x,tut2} ^ j2 dX}{xMM) dxjitiM) 



dt2 

dXl{x,tut2) 



dx. 



dU 



so if we interchange the roles of t\ and ^2, set the cross-derivatives equal and evaluate at 
{x^ ,t\,t2) we get precisely the compatibility identities at that point. 

Now assume that and X"^ are compatible. Given (x", ^1,^2) ^ ^ ^ ^^^c Algorithm F 

to define ^2) in U and define ,2(^1, ^2) in U by 2(^1,^2) := ^^at\'^^'* —X^{x{ti, ^2), ^i, ^2)- 
To complete the proof we must show that z is identically zero in U . But for that it will 
suffice to show that z satisfies the linear ODE — Y]^. ^j^^,. For zero is a solution 
of this equation and z has the initial value zero at t2 = by property b) of Algorithm 
F, and then by uniqueness of solutions z must be zero. From the definition of z and the 
chain-rule, 

dz _ d dxihM) _ dX^ _ ^ dX^ dxj 
dh ~ dh dh ~dh ~ ^~dx^dh 



d dx{h,h) ^ , —X^ 

dh dh \ dh t-f dxj 



=1 



d I dX^ " dX^ 

dX^ ^dX^dx^_(dX^ V— X2 
^^^^^~\^^^^ ^ 

dX^ ^dX^dx^ fdX^ ^ dX^ 1 
dh ^ ^ dxj dh \dh dxj ' 



^dX;^(d_x^_ ,\_^dX 
^ dx, \dh V d^j 



3 
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10.2 Fifth Matlab Project. 

Your assignment for the fifth project is to implement Algorithm F in Matlab. This should 
consist of an M-File, AlgorithmF.m, defining a Matlab function AlgorithmF(Xl,X2,...), 
together with various auxilliary M-Files that implement certain subroutines required by 
the algorithm. (As usual, it is a matter of programming taste to what extent you use 
subfunctions as opposed to functions defined in separate M-Files.) 

Let's consider in more detail just what the inputs and output to AlgorithmF should be. 
First, the output should represent the function ^2) that solves the IVP (*). But since 
we are going to get this solution by solving some ODEs numerically (using Runge-Kutta) , 
in Matlab the output x will be a two-dimensional array x(i,j) of vectors of length n. To be 
specific, we take the domain U of x to be a rectangle al < tl < bl and a2 < t2 < b2, and 
we will use (al,a2) for the point (ti,i2) where the initial condition a;(t5,^2) = is given. 
So far then we see that the first line of our M-File will look something like: 

function x = AlgorithmF(Xl,X2,xO,al,a2,bl,b2, . . .) 

We still have to specify the size of the output array x. This is given by two positive integers, 
TlRes and T2Res that give the number of subintervals into which we divide the intervals 
[al,bl] and [a2,b2]. Let's define hi := (bl - al)/TlRes and h2 := (b2 - a2)/T2Res. We 
take TlRes + 1 subdivision points in [al,bl], al -|- i * hi, i = 0,1, TlRes, and similarly 
we take T2Res + 1 subdivision points [a2,b2], a2 + j * h2, j = 0,1, T2Res, It will 
be convenient to store these in arrays Tl and T2 of length TlRes -|- 1 and T2Res -|- 1 
respectively. That is, Tl(i) = al + i * hi and T2(i) = a2 + i * h2. Then the array x(i,j) 
will have size TlRes + 1 by T2Res + 1. Namely, we will store at x(i,j) the value of the 
solution x{ti,t2) of (*) at the point (Tl(i),T2(j)), or more exactly the approximate value 
found by our implementation of AlgorithmF in which we solve the ODEs approximately 
using Runge-Kutta. So now the first line of our M-File has become: 

function x = AlgorithmF (XI, X2,x0,al,a2,bl,b2, TlRes, T2Res, .. .) 

There is still one more input parameter needed, namely a real number StepSize that 
determines the accuracy of the Runge-Kutta algorithm. Strictly speaking StepSize is not 
the actual size of the steps used in the Runge-Kutta integration, but an upper bound for 
it. When we propagate the solution of an ODE y(t) from a value t = tO where we already 
know it to a next value t = tO -|- h where we need it, we will divide h in a number N of 
equal steps to make h/N less than StepSize and use that many steps in our Runge-Kutta 
method. (Since we will usually settle for accuracy of about 10~^ and Runge-Kutta is 
fourth order, in practice we usually take StepSize approximately 0.01). So finally the first 
line of our M-File has become: 

function x = AlgorithmF (XI, X2,x0,al,a2,bl,b2, TlRes, T2Res, StepSize) 

The first two input parameters XI and X2 represent the vector fields defining the system 
of PDE we are dealing with. Each is a function of n -|- 2 variables, xl, x2,...,xn,tl,t2. In 
practice the actual functions substituted for these parameters will be taken from functions 
defined either in an M-File or an inline expression. 



45 



Math 32a Fall 2003 



R. Palais 



Once you understand the above discussion well you should find writing the actual code for 
AlgorithmF to be straightforward. We start by assigning to x(0,0) the value xO, Then, for 
i = to TlRes, we inductively find x(i+l,0) from x(i,0) by using Runge-Kutta to solve 
the ODE ^ = Xl{x,tl,a2) on the interval [Tl(i),Tl(i+l)] with initial value x(i,0) at 
time tl = Tl(i). Then, in a similar manner, for each i from to TlRes, and each j from 
to T2Res, we inductively find x(i,j+l) from x(i,j) by applying Runge-Kutta to solve the 
ODE ^ =X2(x,Tl(i),t2) on the interval [T2(j),T2(j+l)] with initial value x(i,j) at time 
t2 = T2(j). 

After the solution array x is constructed, it should be displayed either in wireframe (using 
meshgrid) or in patch mode (using surf). 

Here is an "extra credit" addition to project 5. Write an M-File that defines a function 
that checks whether the two vector fields XI and X2 are compatible. I suggest that you 
do this by checking numerically whether the two sides of the n compatibility conditions 
are equal at the points (Tl(i),T2(j)). Here, to allow for roundoff errors, "equal" should 
mean that the absolute value of the difference is less than some tolerance. Use centered 
differences to compute the partial derivatives. See if you can make your test of equality 
"scale invariant". This means that if it succeeds or fails for XI and X2, it should do the 
same if you multiply both XI and X2 by the same scalar. 
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Lecture 11 

Differentiable Parametric Curves 



11.1 Definitions and Examples. 

11.1.1 Definition. A differentiable parametric curve in R"' of class {k > 1) is a 
map t I— > a{t) = {ai{t), . . . ,an{t)) of some interval / (called the domain of a) into R"^. 
We call a regular if its velocity vector, a'{t), is non-zero for all t in /. The image of the 
mapping a is often referred to as the trace of the curve a. 

Some Conventions To avoid endless repetition, in all that follows we will assume that a is 
a regular, differentiable parametric curve in R"^ of class (/c > 2), and we will abbreviate 
this by referring to a as a "parametric curve", or just as a "curve". Frequently we will 
take the domain / of o: to be the closed interval [a, b]. In case n = 2 we will often write 
a{t) = {x{t),y(t)) and similarly when n = 3 we will often write a{t) = {x{t), y{t), z{t)). 

11.1 — Example 1. A Straight Line. Let x^,v^ e with vq ^ 0. Then a{t) = + tv^ 
is a straight line in R"^ with constant velocity v^. The domain is all of R. 

11.1 — Example 2. Let r > 0, n = 2, take / = [0, 2n] and define a{t) = (r cos(t), r sin(t)). 
The trace of a is the set of (x, y) satisfying + y^ = r^, so a is a, parameterization of the 
circle of radius r centered at the origin. 

11.1 — Example 3. Let r, 6 > 0, n = 3, / = R, and define a{t) = (r cos(t), r sin(t), 
The trace of a is a helix of radius r and pitch 

11.2 Reparametrizaion by Arclength. 

Suppose : [c, d] ^ R is and <^'(t) > for all t G [c,d]. Then (j) is monotonic and 
so a one-to-one map of [c,d] onto [a,b] where a = (j){c) and b = (/){d). Moreover, by the 
Inverse Function Theorem, ip = is C'^ and ip'{(p{t)) = l/4>'{t). If a : [a,b] R"' is a 
parametric curve, then o: := a o : [c, d] — > R"' is a parametric curve with the same trace 
as a. In this setting, cj) is called a parameter change and a is called a reparametrization 
of a. Since a and a have the same trace, in some naive sense at least, they represent the 
same "curve". 

Of course for many purposes, the way a curve is parametric is of crucial importance — for 
example, reparametrizing a solution of an ODE will nearly always result in a non-solution. 
However in geometric considerations it is natural to concentrate on the trace and regard 
two parametric curves that differ by a change of parameterization as representing the same 
object. Formally speaking, differing by a change of parameterization is an equivalence 
relation on the set of parametric curves, and we regard the corresponding equivalence 
classes as being the primary objects of study in differential geometry. This raises a problem. 
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Whenever we define some property of parametric curves, then we should check that it is 
independent of the choice of parameterization. As we shall now see, there is an elegant way 
to avoid this complication. Namely, among all the parameterizations of a parametric curve 
a there is one that is the "most natural" choice, namely parameterization by arclength, and 
in our theoretical study of curves and their properties we will usually pefer this one over 
others and define properties of a curve using this parameterization. 

Recall that in elementary Calculus, if a : [a, b] — > R"' is a parametric curve, then its length 
L is defined as L := ||ck'(^)|| dt. More generally, the arclength along a is the function 
s : [a,b] — > [OiL] defined by s{t) = ||q;'(t)|| dr. Since s'{t) = ||Q;'(t)|| > 0, as remarked 
above it has a inverse t : [0, L] [a, 6], and a : [0, L] defined by a(s) = a{t{s)) is 

a reparameterization of a called its parameterization by arclength. Note that by definition, 
the length of a between and s is s, so the name is well-chosen. 

> 11.2 — Exercise 1. Show that a parametric curve a is parametrized by arclength if 
and only if ||Q;'(t)|| is identically equal to 1. 

11.2.1 Remark. From now on we will usually assume that a is parametrized by its 
arclength. It is traditional to signify this by using s as the variable name when dealing 
with such paths. 

Notation If a{s) is a curve parametrized by arclength, then we will denote its unit tangent 
vector at s by t (s) := a'{s). 

11.2.2 Remark. In R there is an important orthogonal transformation that we shall 
denote by R^. It is defined by R^{x,y) = (y, —x), and geometrically speaking it rotates 
any vector v through 90 degrees into a vector orthogonal to v. If a is a curve in R^ 
parametrized by arclength, then we define its normal at s by rf (s) = i?| t (s). 

11.2.3 Remark. In R"^ for n > 2, there is no natural way to assign a normal to a curve 
at every point that works in complete generality. To convince yourself of this, just think 
of the case of a straight line in R^ — there is a whole circle of directions at each point that 
are normal to the line, and no way to prefer any one of them. However, at a point where 
a"{s) 7^ 0, we define the unit normal lt{s) to a at s by rf (s) := y^TT^fyji • (Recall that 
since ||q;'(s)|| is identically equal to one, it follows that its derivative a"{s) is orthogonal 
to a'{s).) 

> 11.2 — Exercise 2. Show that when the straight line a{t) = + tv^ is reparametrized 
by arclength the result is a{s) = x'^ + su where u = j^^^ 

> 11.2 — Exercise 3. Consider the circle of radius r, a{t) = (r cos(t), r sin(t)), with 
/ = [0,27r]. Show that s{t) = rt, so that t{s) = s/r, and deduce that reparameterization 
by arclength gives a{s) — (r cos(s/r), r sin(sr)), and t (s) = (— sin(s/r), cos(s/r)). 

What is the Curvature of a Curve? 

How should we define the "curvature" of a curve? For a plane curve, a{s) = {x{s),y{s)) 
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there is a natural and intuitive definition — namely the rate at which its unit tangent 
vector a'{s) = {x' (s) , y' (s)) is "turning". Now since a'{s) is a unit vector, we can write it 
as a'{s) = {cos{6{s)),sm{6{s))) where 9{s) is the angle a'{s) makes with the x-axis. Thus 
we can define the curvature k{s) of a at s as 0'{s) — the rate of change of this angle with 
respect to arclength. Notice that a"{s) — 6' {s){— sm{{6{s)),cos{{6{s))) = k{s)R^ t (s) = 
k{s)lt{s), so we make the following definition: 

11.2.4 Definition. If ct is a curve in that is parametrized by arclength, then its 
curvature at a{s) is defined to be the scalar k{s) such that a"{s) = k{s)lt{s). 

Note that in the plane, R^, the curvature k(s) can be either positive or negative. Its 
absolute value is of course given by \k{s)\ = ||q;"(s)||. 

11.2.5 Definition. If a is a curve in R"^, n > 2 that is parametrized by arclength, then 

its curvature at a{s) is defined to be k{s) := ||q;"(s)||. 

> 11.2 — Exercise 4. Show that if a{t) = {x{t), y{t)) is a plane parametrized curve that 
is not necessarily parametrized by arclength, then its curvature at a{t) is given by the 
following formula. Hint: 9 = tan"^(2/'/a;'). 

x'{t)y"{t)-y'{t)x"{t) 
(^x'{tr+y'{t)^f 

11.2.6 Remark. Recall that when n > 2 at points where k{s) := ||q;"(s)|| > the normal 
lt(s) was defined by by 'rt{s) := , so the equality a"(s) = k(s)lt(s) holds in this 
case too. But note the subtle difference; for a plane curve the curvature can be positive or 
negative, while in higher dimensions it is (by definition) always positive. 

> 11.2 — Exercise 5. Show that a straight line has curvature zero, and that a circle of 
radius r has constant curvature 1/r. 

> 11.2 — Exercise 6. Show that straight lines are the only curves with zero curvature, 
but show that curves with positive constant curvature are not necessarily circles. (Hint: 
Show that a helix has constant curvature.) However, in R^, show that a curve of constant 
positive curvature k must be a circle of radius 1/k. 

Osculating Circles and Evolutes 

At any point a{s) of a plane curve a there are clearly circles of any radius that are tangent 
to a at this point. In fact, just move out a distance r from a{s) along the normal lt{s) 
and construct the circle with radius r centered at that point. However there is one special 
tangent circle that is "more tangent" than the others, in the sense that it has "second order 
contact" with a. This is the so-called osculating circle at a{s) and is the circle having 
the same curvature as a at this point, namely k{s). Recalling that a circle of radius r 
has curvature 1/r, we see that the radius of the osculating circle is l/k{s), and its center, 
called the center of curvature of a at a{s) is clearly the point c(s) := a{s) — {1 / k{s))lf {s) . 
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As the point a{s) varies over the curve a, the corresponding centers of curvature trace out 
a curve called the evolute of the original curve a. 



11.3 The Fundamental Theorem of Plane Curves 

Recall that EucCR^) denotes the Euclidean group of R"^, i.e., all the distance preserving 
maps of R"^ to itself. We have seen that every element of EucCRj^) can be written as the 
composition of a translation and an orthogonal transformation. 

11.3.1 Definition. Two parametric curves ai and 0:2 in R"' are called congruent if there 
is an element g e Euc{n) such that a2 = g o a\. 

11.3.2 Proposition. The curvature function of a parametrized curve is invariant under 
congruence. That is, if two parametrized curves in R"^ are congruent, then their curvature 
functions are identical. 

> 11.3 — Exercise 1. Prove this Proposition. 

It is a remarkable fact that for plane curves the converse is true, so remarkable that it 
goes by the name The Fundamental Theorem of Plane Curves. The Fundamental Theo- 
rem actually says more — any continuous function k{s) is the curvature function for some 
parametrized plane curve, and this curve is uniquely determined up to congruence. In fact, 
we will get an explicit formula below for the curve in terms of k. 

11.3.3 Proposition. Let /c : [0, L] — > R be continuous and let a{s) — {x{t),y{t)) be a 
parametrized plane curve that is parametrized by arclength. A neccessary and sufEcient 
condition for a to have k as its curvature function is that 9, x,y be a solution on [0, L] of 
the following system of first order ODE: 



> 11.3 — Exercise 2. Prove this Proposition. 

The first ODE of the above system integrates immediately to give 6{a) =60 + k{T) dr. 
If we now substitute this into each of the remaining equations and integrate again we 
obtain the following important corollary. 



11.3.4 Corollary. If A; : [0, L] ^ R is a continuous function, then the set of plane 
curves a{s) — {x{s),y{s)) that are parametrized by arclength and have k as their curvature 



de 

ds 
dx 

ds 
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sm{e). 



cos (6'), 
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function are just those of the form: 

x{s) :— xo + J cos ^6*0 + J k{T) dr 



y{s) := 2/0 + J sin ^6*0 + J k{T) dr^ . 



> 11.3 — Exercise 3. Use this corollary to rederive the fact that straight lines and circles 
are the only plane curves with constant curvature. 

11.3.5 Remark. Note the geometric meaning of the constants of integration xq, j/o and 
^0- The initial point a{0) of the curve a is (a^Oj ?/o)5while is the angle that the initial 
tangent direction a'{0) makes with the x-axis. If in particular we take all three constants 
to be zero and call the resulting curve ao, then we get the general solution from cuq by first 
rotating by 9q and then translating by (xo,yo)- This proves: 

11.3.6 Fundamental Theorem of Plane Curves. Two plane curves are congruent 
if and only if they have the same curvature function. Moreover any continuous function 

: [0, L] ^ R can be realized as the curvature function of a plane curve. 

Why the Fancy Name? 

"Fundamental Theorem" sounds rather imposing — what's the big deal? Well, if you 
think about it, we have made remarkable progress in our understanding of curve theory 
in the past few pages — progress that actually required many years of hard work — and 
that progress is summed up in the Fundamental Theorem. There are two major insights 
involved in this progress. The first is that, from the viewpoint of geometry, we should 
consider curves that differ by parameterization as "the same" , and that we can avoid the 
ambiguity of description this involves by choosing parameterization by arclength. (The 
lack of any analogous "canonical parameterization" for a surface will make our study 
of surface thory considerably more complicated.) The second insight is that, from the 
geometric viewpoiint again, congruent curves should also be regarded as "the same", and 
if we accept this then the simplest geometric description of a plane curve — one that avoids 
all redundency — is just its curvature function. 



11.4 Sixth Matlab Project. 

The Matlab project below is concerned in part with the visualization and animation of 
curves. Before getting into the details of the project, I would like to make a few general 
remarks on the subject of mathematical visualization that you should keep in mind while 
working on this project — or for that matter when you have any programming task that 
involves visualization and animation of mathematical objects. 

1) How should you choose an error tolerance? 

First, an important principle concerning the handling of errors in any computer graphics 
context. Books on numerical analysis tell you how to estimate errors and how to keep 



51 



Math 32a Fall 2003 



R. Palais 



them below a certain tolerance, but they cannot tell you what that tolerance should be — 
that must depend on how the numbers arc going to be used. Beginners often assume they 
should aim for the highest accuracy their programming system can provide — for example 
fourteen decimal places for Matlab. But that will often be far more than is required for 
the task at hand, and as you have already seen, certain algorithms may require a very long 
time to attain that accuracy. The degree of one's patience hardly seems to be the best 
way to go about choosing an error tolerance. 

In fact, there is often is a more rational way to choose appropriate error bounds. For 
example, in financial calculations it makes no sense to compute values with an error less 
than half the smallest denomination of the monetary unit involved. And when making 
physical calculations, it is useless to calculate to an accuracy much greater than can be 
measured with the most precise measuring instruments available. Similarly, in carpentry 
there is little point to calculating the length of a board to a tolerance less than the width 
of the blade that will make the cut. 

This same principle governs in mathematical visualization. My approach is to choose a 
tolerance that is "about half a pixel" , since any higher accuracy won't be visible anyway. 
It is usually fairly easy to estimate the size of a pixel. There are roughly 100 pixels per 
inch, so for example if you are are graphing in a six inch square window, and the axes go 
from minus one to one, then six hundred pixels equals two length units, so half a pixel 
accuracy means a tolerance of ^ or roughly 0.002. 

1) How should you represent a curve? 

Mathematically a curve in R*^ is given by a map of an interval [a, b] into R"^. We can only 
represent the curve on a computer screen when n = 2 or n = 3. Let's consider the case of 
plane curves (n = 2) first. If a{t) — {x{t),y{t)) then for any we can divide the interval 
[a, 6] into N equal subintervals of length h = namely [tk-,tk+i]-, where tk = a + kh 
and k = 0, . . . , AT — 1. We associate to a and N an approximating "A-gon" aN (i.e., a 
polygon with N sides) with vertices Vk ■= {x{tk),y{tk))- It is some aN with N suitably 
large) that actually gets drawn on the computer screen when we want to display a. This 
reduces the actual drawing problem to that of drawing a straight line segment, and the 
latter is of course built into every computer system at a very low level. 

In Matlab the code for plotting the curve a, or rather the polygon aso would be: 

N = 30 

h = (b-a)/N; 

t = a:h.:b ; 

plot (x(t) ,y(t) ) , axis equal; 

To plot a curve a (t) = {x{t),y{t),z{t)) in R^ is really no more difficult. In Matlab the 
only change is that the last line gets replaced by: 
plot3(x(t) ,y(t) ,z(t) ) , axis equal; 

only now one has to be more careful about interpreting just what it is that one sees on the 
screen in this case. The answer is that one again is seeing a certain polygon in the plane, 
but now it is the projection of the polygon in R^ with vertices at Vk '■= {x{tk), y{tk), z{tk))- 
(The projection can be chosen to be either an orthographic projection in some direction 
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or else a perspective projection from some point.) 
1) How do you create animations? 

Viisualization can be a powerful tool for gaining insight into the nature of complex math- 
ematical objects, and frequently those insights can be further enhanced by careful use of 
animation. Remember that time is essentially another dimension, so animations allow us 
to pack a lot more information onto a computer screen in a format that the human brain 
can easily assimilate. The number of ways that animation can be used are far to numer- 
ous to catalog here, but in addition to obvious ones, such as rotating a three dimensional 
object, one should also mention "morphing". Mathematical objects frequently depend on 
several parameters (e.g., think of the family of ellipses: x — acos(^), y — 6sin(^)). Mor- 
phing refers to moving along a curve in the space of parameters and creating frames of an 
animation as you go. 

All animation techniques use the same basic technique — namely showing a succession of 
"frames" on the screen in rapid succession. If the number of frames per second is fast 
enough, and the change between frames is small enough, then the phenomenon of "persis- 
tence of vision" creates the illusion that one is seeing a continuous process evolve. Com- 
puter games have become very popular in recent years, and they depend so heavily on 
high quality animation that the video hardware in personal computers has improved very 
rapidly. Still, there are many different methods (and tricks) involved in creating good 
animations, and rather than try to cover them here we will have some special lectures 
on various animation techniques, with particular emphasis on how to implement these 
techniques in Matlab. 

Matlab Project # 6. 

Your assignment for the sixth project is to implement the Fundamental Theorem of Plane 
Curves using Matlab. That is, given a curvature function : [0, L] — > R, construct and 
plot a plane curve x : [0, L] that has k as its curvature function. To make the 

solution unique, take the initial point of x to be the origin and its initial tangent direction 
to be the direction of the positive a;-axis. You should also put in an option to plot the 
evolute of the curve as well as the curve itself. Finally see if you can build an animation 
that plots the osculating circle at a point that moves along the curve x. For uniformity, 
name your M-File PlaneCurveFT, and let it start out: 
function x = PlaneCurveFT (k,L, option) 

If option is not given (i.e., nargin = 2) or if option = 0, then just plot the curve x. If 
option = 1, then plot x and, after a pause, plot its evolute in red. Finally, if option = 
2, then plot x and its evolute, and then animate the osculating circle (in blue) along the 
curve, also drawing the radius from the center of curvature. 

[To find the curve x, you first integrate k to get ~t = x', and then integrate ~t. The 
curvature, k, will be given as a Matlab function, so you can use the version of Simpson's 
Rule previously discussed for the first integration. But t will not be in the form of a 
Matlab function that you can substitute into that version of Simpson's Rule, so you will 
need to develop a slightly modified version of Simpson's, where the input is a matrix that 
gives the values of the integrand at the nodes rather than the integrand as a function.] 
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Lecture 12 
Curves in 3- Space 



Some Definitions and Notations. In this section a : [0, L] R"^ will denote a curve 
in R"^ that is parametrized by arclength and is of class C^, k > 2. We recall that the 
unit tangent to a at s is defined by t (s) := a'{s). (That it is a unit vector is just the 
definition of a being parametrized by arclength.) The curvature of a is the non- negative 
real-valued function /c : [0, L] — > R defined by k{s) := and we call a a Frenet 

curve if its curvature function is strictly positive. For a Frenet curve, we define its normal 
vector Tf (s)at s by Tf (s) := Since has constant length one, it is orthogonal to 

its derivative ~t (s) = a"{s), hence: 

12.0.1 First Frenet Equation. If a : [0,L] is a Frenet curve then its normal 

vector lt(s) is a unit vector that is orthogonal to 't'{s), and 't'' (s) = k{s)lt{s). 

For the remainder of this section we will assume that a is a Frenet curve. 

12.0.2 Definition. We define the binormal vector to a at s by l^{s) := T^(s) x Tf (s). 
The ordered triple of unit vectors f{s) := {~t {s),lt{s), b (s)) is called the Frenet frame 
of a at a(s), and the mapping s i— > f{s) of [0, L] — > (R^) is called the Frenet framing of 
the curve a. The plane spanned by and ^(s) is called the osculating plane to a at 

s, and the plane spanned by lt{s) and b (s) is called the normal plane to a at a{s). 



12.1 Quick Review of the Vector Product 

We recall that for u = {ui, U2,us) and v = {vi,V2,V3) in R^, we define their vector-product 
u X V G R^ hy u X V := (w2f 3 — V2Us, u^vi — uif 3, U1V2 — V1U2). 

12.1.1 Remark. Symbolically we can write this definition as: 

(Ui U2 Us 
Vi V2 V3 
ei 62 63 

where 61,62,63 is the standard basis for R^. What this means is that we get a correct 
result if we use Cramer's rule to expand this "determinant" by minors of the third row. 
From this formula the following facts are immediate: 

12.1.2 Proposition. The vector product is bilinear and skew-symmetric. That, is it 
is linear in each argument and changes sign when the arguments are interchanged. The 
vector product of u and v vanishes if and only if u and v are linearly dependent, and 
(u X v) -w is the determinant of the matrix with rows u,v, and w. In particular, {uxv) -u 
and {u X v) ■ V are both zero, i.e., u x v is orthogonal to both u and v. 




54 



Math 32a FaU 2003 



R. Palais 



12.1.3 Lemma, {u x v) ■ (x x y) — det 



u • X V • X 
u ■ y V ■ y 



PROOF. Either direct verification, or use linearity in all four variables to reduce the 
result to the case that all of the variables are equal to one of the standard orthonormal 
basis vectors e^, in which case it is obvious. 

12.1.4 Proposition. The norm of u x v is the area of the parallelogram spanned by u 
and V. That is, if 9 is the angle between u and v then \\u x v\\ — \\u\\ \\v\\ sin(^). 

PROOF. WuxvW"^ — {uxv)-{uxv) — deti^ ^ ^ ^ ) = ll-ull^ — ll-ull^ llt;!!^ cos^(^) 

\u-vv-vj 

= ||f 11^ (1 — COS^(^)). I 



> 12.1 — Exercise 1. Show that the "triple vector product" [ux v) x w is given by the 
formula {u • w)v — {v • w)u. Hint. Since it is orthogonal to tt x it must be of the form 
f{w)v + g{w)u, where, since the result is linear in w, f and g have the form a ■ w and b • w, 
so we have (u x v) x w = (a ■ w)v + (b ■ w)u, for some a and b. 

> 12.1 — Exercise 2. If u{t) and v{t) are smooth curves in R^, show that {u{t) xv{t)y = 
u'{t) X v{t) + {u{t) X v'{t) 



12.2 The Frenet Formulas 

We now return to the Frcnct Frame ^(s), (s), h (s) for a. Recall that the binormal vec- 
tor was defined by b {s) :— x rf (s). In particular, as the vector product of orthogonal 
unit vectors it is a unit vector and so its derivative orthogonal b (s) is orthogonal to b (s) 

and so it is a linear combination of and 'rt{s). But in fact b (s) is orthogonal to 

t (s) also, and hence it is a multiple of lf{s). To see this we calculate: 

t'(.) = (T(50 X it{s)y 

= T^'(s) X (s) + X li'{s) 
— k{s)lf{s) X lf{s) + X rf' (s) 
= X rf' (s) 

since r?(s) x lt(s) = 0. Thus ~^ (s) is orthogonal to both ~^{s) and ~t{s) and so: 

12.2.1 Proposition. 'V (s) is a multiple ofli{s). 

12.2.2 Definition. We define the torsion of a at s to be the real number t(s) such the 

(s) = T(s)'ft(s). 

12.2.3 Remark. Since b (s) is the normal to the osculating plane to the curve a at s, the 
torsion measures the rate at which the curve is twisting out of its osculating plane. Note for 
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example, that if t{s) is identically zero, then b (s) is a constant bo, and so the osculating 
plane is fixed, and it follows easily that a{s) lies in a plane parallel to its osculating plane. 
In fact, since ■ bo)' = t (s) ■ bo = 0, {a{s) — a{0)) ■ bo = 0, which says that a lies in 

the plane 11 orthogonal to bo that contains a{0). 

Now that we have computed 'T (s) and b (s), it is easy to compute Tf'(s). In fact, since 
b {s) — t (s) X rf (s), it follows that n(s) = b{s) x so 

-ri\s) = {t{s) X T{s)y 

= 'tis) X T'(s) + V(s) X T(s) 

= 'tis) X {k{s)n{s)) + T{s)lt{s) X T(s) 

= -k{s)T{s) -T{s)t{s) 

The equations that express the derivative of the Frenet frame in terms of the frame itself 
are referred to as the Frenet Equations. Let's rewrite them as a single matrix equation: 

Frenet Equations 

r(.)\' / k{s) \ / 

rtis) = -k{s) -t{s) His) 



12.2.4 Remark. We can write this symbolicly as /' = Af where / = (T(s), ^(s), ^(s)) 
is the Frenet frame, and ^ is a 3 x 3 matrix with entries 0, ±k{s) and ±t(s). The fact 
that this matrix is skew-symmetric is, as we shall see next is just a reflection of the fact 
that {t {s),lf{s), b (s)) are orthonormal. 

12.2.5 Proposition. Let fi : [0, L] R", z = 1, . . . , n, he maps and suppose that 
the fi (t) are orthonormal for all t. Let ttij (t) be the nxn matrix that expresses the f- (t) as a 
hnear combination of the fiit), i.e., f-{t) — Yl^=i (^^ ^^^^ — f'iif) ' fji^) )■ 
Then aij{t) is skew-symmetric. Conversely, if t ^ ciijit) is a continuous map of [0, L] 
into the skew-adjoint nxn matrices and </>!,..., 0n is any orthonormal frame for R", 
then there are unique differentiable maps fi : [0,L] — > R"^ such that fi{0) = and 
f'ii^) — '^'iji^)fji^)> ^^'^ these fi{t) are orthonormal for all t. 

PROOF. Differentiating fiit) ■ fj{t) = 5ij gives f[{t) ■ fj{t) + fi{t) ■ f'^{t) = proving the 
first statement. Conversely, if we are given aij{t) and the (pi, then by the existence and 
uniqueness theorem for ODE, we can solve the IVP fl{t) = Yl^=i '^ij{^)fjif) ^^'^ fii^) = 4'i 
uniquely on the interval [0,L], and we only have to show that Sij{t) := fiit) ■ fj{t) is 
identically equal to dij. We note that Sij{t) satisfies the IVP Sij{0) — dij and 
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d 
dt 



{siAt)) = m-m+m)-m 



n 



n 



^ aik{t)fk{t) ■ fjit) + ajk{t)fi{t)fk{t) 



k=l k=l 



n n 



k=l fc=l 



Since the 0:ij{t) are skew symmetric it is clear that Sij{t) = dij is also a solution, so the 
converse follows from the uniquenes of the solution to this IVP. ■ 

12.3 The Fundamental Theorem of Space Curves 

We are now in a position to generalize our theory of plane curves to an analogous theory 
of space curves. We first make a number of simple observations. 

Observation 1. The Frenet framing associated to a space curve is invariant under or- 
thogonal transformations in the sense that if a and a are space curves and g is an element 
of the orthogonal group 0(R^) such that a = go a, then g maps the Prenet frame of a at 
s to the Frenet frame of a at s. 

Observation 2. The curvature and torsion functions of a plane curve are likewise invariant 
under orthogonal transformation and also under translation. 

> 12.3 — Exercise 1. Prove the validity of these two observations. Hint; They depend 
on little more than the definitions of the quantities involved and the fact that orthogonal 
transformations preserve lengths of curves. 

We now in a position to prove the following analogue of the Fundamental Theorem of 
Plane Curves. 

Fundamental Theorem of Space Curves. Two space curves are congruent if and only 
if they have the same curvature and torsion functions. Moreover any pair of continuous 
functions k : [0, L] — > (0, oo) and r : [0, L] — R can be reahzed as the curvature and 
torsion functions of some space curve. 

PROOF. Given k and r, it follows from the preceding Proposition that we can find 
R"^ valued functions t (t), rf(t), b (t) defined on [0, L] that are orthonormal and satisfy 
the Frenet Equations. Then, just as in the planar case, we can define a curve a{s) := 
Jq t (t) dt. Since t (t) is a unit vector, a is parametrized by arclength and t is clearly 

its unit tangent vector, so it is a consequence of the Frenet Equations that ^(t), and b (t) 
are its normal and binormal and k and r its curvature and torsion. 

Now suppose a is a second curve with the same curvature and torsion as a. If we translate 
a by (5(0) — a(0) and then rotate it by the rotation carrying the Frenet frames of a at 
into that of a at 0, then we get a curve congruent to a that has the same initial point and 
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initial Frenet frame as a, so it will sufice to show that if a and a have the same initial 
point and Frenet frame, then they are identical. But from the uniqueness of the solution of 
the IVP for the Frenet equations it now follows that a and a have the same Frenet frame 
at all s G [0, L], and it the follows that both and q:(s) equal t {t) dt. ■ 

Matlab Project # 7. 

As you have probably guessed, your assignment for the seventh Matlab project is to im- 
plement the Fundamental Theorem of Space Curves. That is, given a (positive) curvature 
function k : [0, L] R, and a torsion function r : [0, L] R, construct and plot a space 
curve X that has k as its curvature function and r as its torsion function. To make the 
solution unique, take the initial point of x to be the origin and its initial tangent direction 
to be the direction of the positive x-axis. You should also use plot3 to plot the curve. See if 
you can create an animation that moves the Frenet Frame along the curve. For uniformity, 
name your M-File SpaceCurveFT, and let it start out: 

function x = SpaceCurveFT (k,tau,L) 



12.4 Surface Theory: Basic Definitions and Examples 

The theory of curves in the plane, three-space, and higher dimensions is deep and rich in 
detail, and we have barely scratched the surface. However I would like to save enough time 
to cover at least the basics of surface theory, so we will now leave the theory of curves. 

How should we define a surface? As with curves, there are many possible answers, and we 
will select not the most general definition but one that is both intuitive and leads quickly 
to a good theory. The simplest curve is just an interval in the line, and we defined other 
curves to be maps of an interval into R" with non-vanishing derivative. The natural two 
dimensional analog of an interval is a connected open set or domain O in R^. 

12.4.1 Definition. A parametric surface in R^ {k > 3) is a map : O ^ "B? 

(where O is a domain in R^) such that its differential, DTp, has rank 2 at all points p El O. 

Of course, intuitively speaking, it is the image of T that constitutes the surface, but as 
with curves we will allow ourselves a looseness of language and not always distinguish 
carefully between T and its image. 

Notation. Just as it is traditional to use t as the parameter of a curve (or s if the parameter 
is arclength), it is traditional to use u and v to denote the parameters of a parametric 
surface, so a surface is given by a mapping (u, v) ^ ^("U, v) = {J-'i{u, v),J-'2{u, v),J-'2{u, v)). 
Instead of the Ti{u, v) it is also traditional to use {x{u, v).y{u.v), z{u, v)) to denote the three 
components of J^{u,v), and we will often use this notation without explicit mention when 
it is clear what surface is under consideration. 

> 12.4 — Exercise 1. Show that if po = (uq^vq), then the condition that DJ^p has rank 
two is equuivalent to and being linearly independent. 
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12.4.2 Definition. If ^ : C ^ is a parametric surface in and p G C, the tangent 
space to J-' at p is defined to be the image of the linear map DJ^p : R^ ^ R^, and we 
denote it by TJ-'p. We note that TJ^p is by assumption a two-dimensional linear subspace 
of R^ and that and ^"^^q"'""-* is clearly a basis. This is called the basis for TJ^p 
defined by the parameters u,v. We define the normal vector to T atp to be the unit vector 
^(p) obtained by normalizing x The map ^ : O ^ p ^ ^(p) of 
O to the unit sphere C R^ is called the Gauss map of the surface 

12.4.3 Remark. You will probably guess that the "curvature" of the surface JF (whatever 
it means) will somehow be measured by the rate at which the normal v (p) varies with p. 

> 12.4 — Exercise 2. Show that the tangent space to at p and the tangent space to 

at v (p) are the same. 

12 A A Remark. It is natural to try to use what we have learned about curves to help 
us investigate surfaces, and this approach turns out to be very effective. It v{t)) is a 

smooth parametric curve in the domain O of the of the surface JF, then a{t) := J^{u{t), v{t)) 
is a parametric curve in R"^, and we shall call such curve a parametric curve on the 
surface JF. If we put uq = u{to), vq — v{to) and p — {uq,vo), then the by the chain- 
rule, the tangent vector, a' (to), to a{t) at to is DJ^p{u'{to),v'{to)), an element of the 
tangent space TTp to T at p. In terms of the basis defined by the parameters u,v we have 

a {to) - U {to) g;^ h V {to) g;^ — . 

> 12.4 — Exercise 3. Show that every element of TJ^p is the tangent vector to some 
curve on the surface as above. 



12.4.5 Remark. There is a special two-parameter "net" of curves on a surface JF defined 
by taking the images of the straight lines in the domain O that are parallel to the u, v 
axes. Through each point po — {uo, vq) there are two such lines, t i— > {uo + t, vq) and 
t I— > {uo,vo + t), called the tt-gridline through p and the v-gridline through p, and to 
visualize the surface, one plots the images under .F" of a more or less dense collection of 
these "gridlines". 

> 12 A — Exercise 4. Show that the tangent vectors to the u and v gridlines through p 
are just the elements of the basis for TJ^p defined by the parameters u, v. 

There are two types of surfaces that everyone learns about early in their mathematical 
training — graphs and surfaces of revolution. 

12.4 — Example 1. Graphs of Functions. Given a real-valued function / : O — > R we get 

a parametric surface : C ^ R^ called the graph of / by J^(u, v) := (u, v, f(u, v)). 

12.4 — Example 2. Surfaces of Revolution. Let t i— > a{t) — {x{t),z{t)) be a curve in the 
X, 2;-plane that does not meet the 2;-axis — i.e., x{t) > for all t in the domain (a, b) of a, and 
let O = (0, 27r) x (a, b). We define a surface .F" : C — > R^, called the surface of revolution 
(about the 2;-axis) defined from the curve a, by T{u,v) := {x{v)cos{u),x{v)si'n{u),z{v)). 
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Lecture 13 

The Fundamental Forms of a Surface 



In the following we denote by : C — > a parametric surface in R'^, J^(u,v) = 
{x{u,v),y{u,v), z{u,v)). We denote partial derivatives with respect to the parameters 
u and V by subscripts: J-'u '■= ^ and J-'y := and similarly for higher order derivative. 
We recall that if p — {uo,vo) G O then J-'u{p) and J-'vip) is a basis for TjFp, the tangent 
space to at p, the unit normal to at p is u (p) := ||^"(p)x!y-"(p)|| ^^^^ '^^ 
map v : O ^ the Gauss map of the surface J^. 



13.1 Bilinear and Quadratic Forms 

There are two important pieces of data associated to any surface, called its First and 
Second Fundamental Forms. 

The First Fundamental Form encodes the "intrinsic data" about the surface — i.e., the 
information that you could discover by wandering around on the surface and making 
measurements within the surface. 

The Second Fundamental Form on the other hand encodes the information about how the 
surface is embedded into the surrounding three dimensional space — explicitly it tells how 
the normal vector to the surface varies as one moves in different directions on the surface, 
so you could say it tells how the surface is curved in the embedding space. 

These two "fundamental forms" are invariant under congruence, and moreover, they are a 
complete set of invariants for surfaces under congruence, meaning that if two surfaces have 
the same first and second fundamental forms then they are congruent. This latter fact is 
part of the Fundamental Theorem of Surfaces. But, it turns out that, unlike the curvature 
and torsion of a curve, not every apparently possible choice of First Fundamental Form 
and Second Fundamental Form for a surface can be realized by an actual surface. For this 
to be the case, the two forms must satisfy certain differential identities called the Gauss- 
Codazzi Equations and this fact is also part of the Fundamental Theorem of Surfaces. 

Before considering the definitions of the fundamental forms on a surface, we make a short 
detour back into linear algebra to consider the general notions of bilinear and quadratic 
forms on a vector space. 

13.1.1 Definition. Let Vhea, real vector space. A real- valued function S : 1/ x 1/ — > R is 
called a bilinear form on V if it is linear in each variable separately when the other variable 
is held fixed. The bilinear form B is called symmetric ( respectively skew- symmetric) if 
B{vi,V2) = B{v2,vi) (respectively B{vi,V2) = —B{v2,vi)) for all vi,V2 G V. 

> 13.1 — Exercise 1. Show that every bilinear form on a vector space can be decomposed 
uniquely into the sum of a symmetric and a skew-symmetric bilinear form. 
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13.1.2 Definition. A real- valued function Q on a vector space V is called a quadratic 
form if it can be written in the form Q{v) — B{v,v) for some symmetric bilinear form B 
on V. (We say that Q is determined by B. ) 

> 13.1 — Exercise 2. (Polarization Again.) Show that if Q is a quadratic form on V 
then the bilinear form B on V such that Q{v) = B{v,v) is uniquely determined by the 
identity B{vi,V2) = l{Q{vi + V2) - Q{vi) - Q{v2)). 

Notation. Because of this bijective correspondence between quadratic forms and bilinear 
forms, it will be convenient to use the same symbol to denote them both. That is, if Q 
is a quadratic form then we shall also write Q for the bilinear form that determines it, so 
that Q{v) = Q{v,v). 

13.1.3 Remark. Suppose that V is an inner-product space. Then the inner product is 
a bilinear form on V and the quadratic form it determines is of course Q{v) — ||f ||^. More 
generally, ii A : V ^ V is any linear operator on V, then B'^(vijV2) = {AvijV2) is a 
bilinear form on V and B^ is symmetric (respectively, skew-symmetric) if and only if A is 
self-adjoint (respectively, skew- adjoint). 

> 13.1 — Exercise 3. Show that any bilinear form on a finite dimensional inner-product 
space is of the form B^ for a unique choice of self-adjoint operator A on and hence 
any quadratic form on an inner-product space is of the form Q^{v) = {Av^ v) for a unique 
choice of self- adjoint operator A onV. 

13.1.4 Remark. If S is a bilinear form on a vector space V and if vi, . . . , is a basis for 

V then the hij = B{vi, Vj) are called the matrix of coefficients of the form B in this basis. 
Clearly, if w = Yli^i^i ^^'^ ^ — Yli^i^i^ than B{u^w) = hijUiWj. The bilinear form 
B is symmetric if and only if the matrix hij is symmetric, and in that case the quadratic 
form Q determined by B is Q{u) = hjUiUj. 

13.1.5 Remark. Suppose that T : F — > y is a self-adjoint operator on an inner-product 
space V, and that vi,. . . ,Vn is a basis for V. What is the relation between the matrix 
bij = (TvijVj) of the symmetric bilinear form B^ defined by T, and the matrix ^ of T in 
the basis tJi, . . . , w^? Your first guess may be that these two matrices are equal, however 
life is not quite that simple. 

13.1.6 Proposition. Let T : V ^ V be a self-adjoint operator on an inner-producr 

space V . If b = (bij) is the matrix of coefEcients of the bihnear form B^ determined 
by T and A is the matrix of T, both with respect to the same basis Vi,. . . ,Vn for V, 
then A = g~^b, where g is the matrix of inner-products gij — {vi,Vj), i.e., the matrix of 
coefEcients of the bilinear form given by the inner-product. 

PROOF. By the definition of A, Tvi = Yl7=i "^kiVk, hence bij = {YJi^i ^kiVk,Vj) = 
Akigkj, i-e., b = A^g, where A^ is the transpose of A, Hence A* = bg~^, and since b and g 
are symmetric, A — {bg~^Y — g~^b. 



61 



Math 32a Fall 2003 



R. Palais 



13.2 Quadratic Forms on a Surface 

13.2.1 Definition. If : O — > R*^ is a parametric surface in R"^, then a quadratic form 
on Q, we mean a function p i— > Qp that assigns to each p in O a, quadratic form Qp on 
the tangent space TJ^p of at p. 

13.2.2 Remark. Making use of the bases J^u{p)-,^v{p) in the TjFp, a quadratic form Q 
on T is described by the symmetric 2x2 matrix of real-valued functions Qij : O ^ R 
defined by Qij{p) Qi^xi (p), (p)), (where xi = u and X2 — v). These three functions 
Qii, Qi2, and Q22 on O determine the quadratic form Q on uniquely: if w E TJ^p, 
then w = iTu{p) + vJ^v, and Qp{w) = Qii{p) + 2 Qi2{p) if] + Q22{p) if- We call the 
Qij the coefficients of the quadratic form Q, and we say that Q is of class if its three 
coefficients are C^. Note that we can choose any three functions Qij and use the above 
formula for Qp{w) to define a unique quadratic form Q on T with these Qij as coefficients. 
This means that we can identify quadratic forms on a surface with ordered triples 
of real-valued functions on its domain. 

Notation. Because of the preceding remark, it is convenient to have a simple way of 
referring to the quadratic form Q on a surface having the three coefficients A, B, C. There 
is a classical and standard notation for this, namely: 

Q = A{u, v) dv^ + 2B{u, v) du dv + C{u, v) dv'^. 

> 13.2 — Exercise 1. To see the reason for this notation — and better understand its 
meaning — consider a curve in O given parametrically by t 1-^ {u{t),v{t)), and the corre- 
sponding image curve a{t) := J-'{u{t),v{t)) on JF. Show that 

Q(a'it)) = AHt)Mt)) (^) % Biuit), .W) (f ) (f ) + C(u(t), (^) ^ 

The point is that curves on JF are nearly always given in the form t ^ J^{u{t), v{t)), so a 
knowledge of the coefficients A, B, C as functions ot w, v is just what is needed in order to 
compute the values of the form on tangent vectors to such a curve from the parametric 
functions u{t) and v{t). As a first application we shall now develop a formula for the length 
of the curve a. 

Definition of the First Fundamental Form of a Surface 

Since TjFp is a linear subspace of R^ it becomes an inner-product space by using the 
restriction of the inner product on R*^. Then the First Fundamental Form on denoted 
by J-^, is defined by Ip{w) := ||«;|| , and its coefficients are denoted by , , . When 
there is no chance of ambiguity we will omit the superscript from and its coefficients. 
Thus: 

= E^{u, v) du^ + 2F^{u, v) du dv + G^{u, v) dv^, 
where the functions E-^, F*^, and G-^ are defined by: 



E^ 




■ u 


2 I 2 1 2 




•J u 


■ T 




G^ 


• — "F u 


F 


2 1 2 1 2 
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The Length of a Curve on a Surface 

Let t ^ {u{t),v{t)) be a parametric curve in O with domain [a, b]. By the above exercise, 
the length, L, of the curve a : 1 1— > J^{u{t),v{t)) is: 

L= ^JI{a'{t))dt 

J a 

Alternative Notations for the First Fundamental Form. 

The First Fundamental Form of a surface is so important that there are several other 
standard notational conventions for referring to it. One whose origin should be obvious is 
to denote to it by ds^, and call ds = Vds^ the "line element" of the surface. 



13.3 The Shape Operator and Second Fundamental Form 

Wc next consider the differential Dup of the Gauss map : (9 ^ at a point p of O. 
Strictly speaking it is a linear map of R2 R^ but as we shall now see it has a natural 
interpretation as a map of TpJ^ to itself. As such it plays a central role in the study of the 
extrinsic properties of and is called the shape operator of T at p. Moreover, we shall 
also establish the important fact that the shape operator is a self-adjoint operator on Tp!F 
and so defines a quadratic form on J^, the Second Fundamental Form of the surface. 

In fact, since DJ-'p is by definition an isomorphism of onto TpJ^, given w G T^JF, we can 
define Di>p{w) := (^)t=„'^(«(^)), where a is any curve of the form a{t) := jF(7(t)) with 
7(t) a curve in O with 7(0) = p such that DJ^p{'y' (0)) = w. Then since u^ait)) G for 
all t, it follows that Dvp{w) G Tj^(p)S^ ~ ~ ^-^p^ completing the proof that Dvp maps 
TTp to itself. 

13.3.1 Definition. The linear map —Dvp : TpT —>■ TpT is called the shape operator of 
the surface T at p. 

13.3.2 Remark. The reason for the minus sign will appear later. (It gives the curvatures 
of the standard surfaces their correct sign.) 

13.3.3 Theorem. The shape operator is self-adjoint. 

> 13.3 — Exercise 1. Prove this. Hint — you must show that for all wi,W2 G T^JF, 
{Di'pWi,W2) = {wi, DvpW2)- However it suffices to to prove this for wi and W2 taken from 
some basis for TpjF. (Why?) In particular you only need to show this when the Wi are 
taken from {JF^, J^v}- For this, take the partial derivatives of the identities v) =Q and 
{Tv^ T^) = with respect to u and v (remembering that Uu = -Dz^(jFy)), so that for example 
{Du{J^u)),^v) = {i^u,^v) = {{i^,^v))u - W,^vu) = - {i^,^vu), etc. 
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Definition of the Second Fundamental Form of a Surface T 

We define the Second Fundamental Form of a surface T to be the quadratic form defined 
by the shape operator. It is denoted by // , so for w e TpT, 

II^{w) = -{Dup{w),w). 

We will denote the components of the Second Fundamental Form by L-^ , M-^ , N-^ , so that 

11^ = L^{u, v) du^ + 2M^{u, v) du dv + N^{u, v) dv^, 

where the functions L-^, M-^, and N-^ are defined by: 

:= -Dv{Tu) -Tu^y ■ Tuu, 

:= -Dv{Tv) ■Tv = v-Tvv. 

As with the First Fundamental Form, we will usually omit the superscript T from //■^ and 
its components when it is otherwise clear from the context. 



Matrix Notation for First and Second Fundamental Form Components 

It is convenient when making computations involving the two fundamental forms to have 
a more uniform matrix style notation for their components relative to the standard ba- 
sis Tui^v for TpjF. In such situations we will put ti = u and t2 = v and write / = 
Y.i,j9ijdiidij and // = Y.i,j ^ij dUdtj. Thus gn = E, gi2 = 921 = F, g22 = G, and 
£11 = L, £12 = £21 = M, £22 = N. The formulas giving the Qij and lij in terms of partial 
derivatives of are more uniform with this notation (and hence easier to compute with): 
9i3 = • , and iij = -v^ • ^t^ = ^ • ^utj ■ 

We will refer to the 2x2 matrix gij as g and its inverse matrix by g~^, and we will denote 
the matrix elements of the inverse matrix by g^^ . By Cramer's Rule: 

-1 ^ 1 f 922 -912 
det{g) \-g12 911 

i.e., = 5r22/det(^), g'^'^ = gn/ det{g), and = g^^ = -gi2/ det{g). 

13.3.4 Remark. By Proposition 13.1.6, the matrix of the Shape operator in the basis 
^ti,^t2 is g~'^i. 

> 13.3 — Exercise 2. Show that \\J^u x ^v\\'^ = det{g) = EG — F^, so that the unit 

normal to J-' is u — f^^'^'!,^ . Hint — recall the formula (uxv)-(xxy) — det ( ^ ^ v x \ 
VEG-F^ ^ ^ ^ \u-yv-yl 

from our quick review of the vector product. 
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Geometric Interpretation of the Second Fundamental Form 

Definition. Let a{s) = J^{u{s),v{s)) be a regular curve on and let n{s) denote its 
unit normal, so a"{s) = k{s) n{s), where k{s) is the curvature of a. We define the normal 
curvature to a, denoted by kn{s), to be the component of a"{s) in the direction normal to 
JF, i.e., the dot product of a"{s) — k{s)n{s) with iy{a{s)), so that kn{s) = k{s) cos{9{s)), 
where 9{s) is the angle between the normal n{s) to a and the normal h'{a{s)) to T. 

13.3.5 Meusnier's Theorem. If a{s) is a regular curve on a surface T , then its normal 
curvature is given by the formula /c„(s) = 11'^ {a' {s)) . In particular, if two regular curves 
on T pass through the same point p and have the same tangent at p, then they have the 
same normal curvature at p. 

PROOF. Since a is a curve on J^, a'{s) is tangent to at a{s), so ct'(s) • u{a{s)) is 
identically zero. Differentiating gives a"{s) ■ iy'{a{s)) + a'{s) ■ Dv{a'{s)) = 0, so kn{s) := 
a"{s) ■ iy{a{s)) = -a'{s) ■ Dv{a'{s)) = II{a'{s)). ■ 

13.3.6 Remark. Recall that the curvature of a curve measures its second order proper- 
ties, so the remarkable thing about Meusnier's Theorem is that it says, for a curve a that 
lies on a surface J-', k^ the normal component of the curvature of a depends only on its 
first order properties {a') and the second order properties of {Du). The obvious conclu- 
sion IS measures the curvature of a that is a consequence of its being constrained 
to lie in the surface. 

13.3.7 Remark. If is a unit tangent vector to T at p, then w and v{p) determine a 
plane 11 through p that cuts in a curve a{s) lying on !F with q;(0) = p and q;'(0) = tu, 
This curve a is called the normal section of T in the direction by w. Since a lies in the 
plane H, a"(0) is tangent to H, and since it is of course orthogonal io w = a'(0), it follows 
that Q!"(0) must be parallel to — i.e., the angle 9 that Q!"(0) makes with pip) is zero, 
and hence by the definition of the normal curvature, kn = kcos{9) = k, i.e., for a normal 
section, the normal curvature is just the curvature, so we could equivalently define the 
Second Fundamental Form of !F by saying that for a unit vector w G TpjF, II{w) is the 
curvature of the normal section at p in the direction w. (This is how I always think of //.) 

> 13.3 — Exercise 3. Show that the First and Second Fundamental Forms of a Surface 
are invariant under congruence. That is, if g is an element of the Euclidean group 
then g o has the same First and Second Fundamental Forms as J-'. 

The Principal Directions and Principal Curvatures 

Since the Shape operator, —Dup, is a self-adjoint operator on TpJ-", by the Spectral Theorem 
there an orthonormal basis ei, 62 for T^JF consisting of eigenvectors of the Shape operator. 
The corresponding eigenvalues Ai, A2 are called the principal curvatures at p, and ei and 
62 are called principal directions at p. Recall that in general, if T : V ^ 1/ is a self-adjoint 
operator, then a point on the unit sphere of V where the corresponding quadratic form 
{Tv,v) assumes a minimum or maximum value is an eigenvector of T. Since TpjF is two- 
dimensional, we can define Ai and A2 as respectively the minimum and maximum values 
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of IIp{w) on the unit sphere (a circle!) in TpJ^, and ei and 62 as unit vectors where these 
minimum and maximum values are assumed. We define the Gaussian Curvature K and 
the Mean Curvature H at p to be respectively the determinant and trace of the Shape 
operator —Dup, so K — X1X2 and H — Xi + A2. 

13.3.8 Remark. It is important to have a good formulas for H, and the principal 

curvatures in terms of the coefficients of the first and second fundamental forms (which 
themselves can easily be computed from the parametric equations for the surface) . Recall- 
ing from 13.3.4 that the matrix of the Shape operator in the usual basis Tu-, is g~^^-, it 
follows that: 

det(£) £11^22 -^?2 



K = 



det{g) 911922 -gh 



> 13.3 — Exercise 4. Show that the Mean Curvature is given in terms of the coefficients 
of the first and second fundamental forms by the formula: 

_ ff22^11 - 2^12^12 +ffll^22 
^11^22 - 9l2 

(Hint: The trace of an operator is the sum of the diagonal elements of its matrix with 
respect to any basis.) 

13.3.9 Remark. Now that we have formulas for H and K in terms of the gij and iij, 
it is easy to get formulas for the principal curvatures Ai, A2 in terms of H and K (and so 
in terms of 9ij and £y). Recall that the so-called characteristic polynomial of the Shape 
operator is x{X) := det(— Dzv— A/) = (A— Ai)(A— A2) = X'^—HX+K, so that its roots, which 
are the principal curvatures Ai, A2 are given by Ai = and A2 = — ■ 

13.3.10 Remark. There is a special case one should keep in mind, and that is when 
Ai = A2, i.e., when IIp is constant on the unit sphere of TpjF. Such a point p is called an 
umbillic point of While at a non-umbillic point the principal directions ei and 62 are 
uniquely determined up to sign, at an umbilic point every direction is a principal direction 
and we can take for ei, 62 any orthonormal basis for the tangent space at p. 



Parallel Surfaces 

We define a one-parameter family of surfaces !F(t) : O — > R^ associated to the surface !F 
by T{t){u,v) = T{u,v) — v{u,v). Clearly J^(0) = T and \\!F{t){u,v) — T{u,v)\\ = t. Also, 
DJ-'{t)p = DTp + tDup, and since Dup maps TpjF to itself, it follows that TpJ-'{t) = TpT 
(at least for t sufficiently small). So, for obvious reasons, we call J-'{t) the parallel surface 
to at distance t. 

> 13.3 — Exercise 5. Since TpJ-'(t) = TpJ^, it follows that the First Fundamental Forms 
/■^(*) of the parallel surfaces can be regarded as a one-parameter family of quadratic forms 
on jr. Show that = {ft),=o ' 
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13.3 — Example 1. A plane is a surface ^ : — > given by a map of the form 

p i-^ xq + T{p) where T : R^ is a linear map of rank two. If we call 11 the image 

of P (a two-dimensional linear subspace of R^), then clearly the image of JF is xq + H, 
the tangent space to J-' at every point is 11, and the normal vector Up is the same at every 
point (one of the two unit vectors orthogonal to H). Here are three ways to see that the 
Second Fundamental Form of such a surface is zero: 

a) The normal sections are all straight lines, so their curvatures vanish. 

b) Since v is constant, the parallel surfaces J^{t) are obtained from by translating it by 
ti', a Euclidean motion, so all of the First Fundamental Forms J-^^*) are the same, and 
by the preceding exercise 11-^ = 0. 

c) Since the Gauss Map : R^ — > is a constant, the Shape operator —Df is zero. 

13.3 — Example 2. The sphere of radius r. We have already seen how to parametrize 
this using longitude and co-latitude as the parameters. Also, any hemisphere can be 
parametrized in the usual way as a graph. However we will not need any parmetrization 
to compute the Second Fundamental Form. We use two approaches. 

a) The normal sections are all great circles, so in particular they are circles of radius r, and 
so have curvature -. Thus the Shape operator is - times the identity. 

b) If J-'{t) is the parallel surface at distance t, then clearly J-'{t) — "^-^T = (1 + so 
/•^(*) = (1 -)- ^)/-^, and this time the exercise gives 11'^ — ■ 

It follows that the Gauss Curvature of the sphere is K = ^, and its mean curvature is 

r 



67 



Math 32a Fall 2003 



R. Palais 



Lecture 14 

The Fundamental Theorem of Surface Theory 



Review of Notation. 



dT 

dti ' 



In what follows, (^1,^2) ^ ^(^1,^2) is a parametric surface in R , ^ : C — > R . 

• Partial derivatives with respect to ti and ^2 are denoted by subscripts: Tt^ 

•rtitj ■— dtitj ' 

• The standard basis for TpJ^ — the tangent space to ^ at a point p e O — is J^n , ■ 

• The unit normal to at » is z/(») = . 

• The matrix g of the First Fundamental Form with respect to the standard basis is the 

2x2 matrix gij = Tt, {p) ■ Tt. (p). 

• The Shape operator at p is the self-adjoint operator —Dup : TpT TpJ^. 

• The Shape operator defines the Second Fundamental Form which has the 2x2 matrix 

of coefficients I given by lij = -Uti ■ J^tj = v ■ Ttity 

• The matrix of the Shape operator in the standard basis is g~^i. 
14.1 The Frame Equations. 

At each point p e C we define the standard frame at f (p) = (fi(p), ^2{p)i fsCp)) to be the 
basis of R^ given by fi(p) := Tt^{p),U{p) — ^t2{.P)iU{p) '■= ^(p)- Note that fib),f2(p) 
is just the standard basis for TpjF. We will regard f as a map from O into 3x3 matrices, 
with the rows being the three basis elements. Since f{p) is a basis for R^, any v G R^ can 
be written uniquely as a linear combination of the fj(p): v — ^jQfi(p)- In particular, 
we can take in turn for v each of {fj)tk{p) this defines uniquely a 3 x 3 matrix Pji{p) 
such that {^j)tu{p) = Ylij Pjiip)fiip)- We can write these equations as a pair of equations 
between five matrix-valued functions f, f^^, f^.^, P^, and P^, defined on O, namely: 



ft, = f 
ft. = f 

and we call these equations the frame equations for the surface !F. 

What makes these equations so interesting and important is that, as we will see below, the 
matrix- valued functions P^ and P2 

can be calculated explicitly from formulas that display 
them as fixed expressions in the coeffients gij and lij of the First and Second Fundamental 
Forms and their partial derivatives. Thus, if the First and Second Fundamental 
Forms are known, we can consider the Frame Equations a& a coupled pair of 
first order PDE for the frame field f , and it follows from the Frobenius Theorem that 
we can solve these equations and find the frame field, and then with another integration we 
can recover the surface JF. Thus the frame equations are analogous to the Frenet equations 
of curve theory, and lead in the same way to a Fundamental Theorem. Now the fun begins! 
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14.1.1 Lemma. Let V be an inner-product space, f = (f^, . . . ,f„) a basis for V, and G 
the matrix of inner-products Gij = (fi,fj)- Given x = J27=i^iU ■'^^ •= i^jfi)- 

Then = Yl]=i ^ji^j = YJj=i ^ij^j^ or in matrix notation, {li, . . . ,^n) = {xi, ■ ■ ■ , Xn)G^, 

so {xi,...,XnY = G-^(^i,...,^n)*- 



PROOF, = (e;=i ^jfj, u) = E?=i {fr uy ■ 

14.1.2 Remark. Here is another way of phrasing this result. The basis f^, . . . , f„ for V 

determines two bases for the dual space V* , the dual basis £i defined by ii{fj) = Sij and the 
basis f*, defined by f*(f ) := {v, f j), and these two bases are related by f* = Ej=i ^ij^j- 

14.1.3 Theorem. 

'g'' g'' o\ / i(^7ii)t, Ugiih, 

ly \ 4i ii2 

g'' g'^ o\ fUgii)t2 {gi2)t2 - Ug22)t, 

G-'A'=\ g^' g^^ oil \{g22)t. i(^22)t. 





1/ V £12 ^22 

PROOF. In the lemma (with n = 3) take f = f (p), the standard frame for T at so that 

(g\\ gi2 
912 922 
1 

and hence 

= g'^ g^^ 
\ 

(recall that the g~^ — g^^ is the matrix inverse to g — gij), and take x — (fjOt^, so by the 
conclusion of the Lemma, A^j = = ifj)tk ' fi- Thus, for example, for z = 1,2: 

k 11 

Next note that {gi2)u = i^ti ■ ^t2)ti = ^uti ■ + -^ti ■ -^tita = -^titi ' ^t2 + i(fi'ii)t2: so: 

^21 = (fi)ti • U = ^titi ■ ^t2 = (fl'i2)ti - 2(5'ii)t2- 
and interchanging the roles of ti and t2 gives 

{gi2)t2 - \{g22)t^- Also 



^12 


(f2)t2 


■fl 


= ^ t2t2 




^12 — 


(f2)ti ■ 


•fl 


= •^tlt2 




^21 — 


(fl)t2 ■ 


•f2 


= ^txt2 


■^t2 = 



)t2 and 



-(J^ti ■ J^ti)t2 - 2(911)12- 
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For z = 1,2, 

^3 = (f3)t. • fi = ^t, ■ = Dv{Tt,) ■ Tu = -4i, 
and since fg is orthogonal to f^, = (fg ■ f Jt^ = (f3)t, ■ f , + f 3 ■ (f^t^, hence 

Finally, since fa • f 3 = = 1, (fa • js)^, = 0, so 

43 = (f3k-f3 = ^(f3-f3k=0. . 

Henceforth we regard the 3x3 matrix- valued functions G, G~^, and P'' in O as being 
defined by the formulas in the statement of the above theorem. 

14.1.4 Corollary (Gauss-Codazzi Equations). If gij and £ij are the coefRcients of 
the First and Second Fundamental Forms of a surface : C — > R^, then the matrix-valued 
functions and P^ defined in O by the above Theorem satisfy the matrix identity 

- p2 ^ plp2 _ p2pl 

called the Gauss-Codazzi Equations. 

PROOF. Differentiate the first of the Frame Equations with respect to ^2 and the second 
with respect to ti and set f^^^^ — ft2ti- "^^^^ gives f^^P^ + fP/^ — f^^P^ + fP^^. Substituting 
for and f^^ their values from the Frame Equations, gives 

f{Pt\-Pl-{P'P'-P'P')) = 0, 
and since f is a non-singular matrix, the corollary follows. ■ 

14.2 Gauss's "Theorema Egregium" (Remarkable Theorem). 

Karl Friedrich Gauss was one of the great mathematicians of all time, and it was he who 
develped the deeper aspects of surface theory in the first half of the nineteenth century. 
There is one theorem that he proved that is highly surprising, namely that K, the Gauss 
Curvature of a surface (the determinant of the shape operator), is an intrinsic quantity 
that is it can be computed from a knowledge of only the First Fundamental Form, and so 
it can be found by doing measurements within the surface without reference to how the 
surface is embedded in space. Gauss thought so highly of this result that in his notes he 
called it the "Theorema Egregium", or the remarkable (or outstanding) theorem. Notice 
that by Theorem 14.1.3, the matrix entries of Pj^j with 1 < ^, J < 2 depend only on the gij 
and their partial derivatives, so to prove the intrinsic nature of K it will suffice to get a 
formula for it involving only these quantities and the g^^ . 
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14.2.1 Theorema Egregium. 



K 



9^^ {911922 -912) 



PROOF. In the matrix Gauss- Codazzi Equation, consider the equation for the first row 
and second column, 

3 

{Pl2)t2 - {Pl2)ti = X](-Plj-Pf2 - PljPj2)- 
J = l 

If we move all terms involving P^j with z, j < 3 to the left hand side of the equation, the 
result is: 

2 

{Pl2)t2 ~ {Pl2)ti - 7-^7^2 ~ Plj^h) ~ -^13-^3^2 ~ -^13-^3^2- 

Now use Theorem 14.1.3 to find the matrix elements on the right hand side of this equation: 
Ph = -{9''hi + 9'^h2), Ph = -{9''h2 + 9'^h2), Ph = 42, PI2 = ^2. Thus: 

PlzPi2 - PhPh = -{9''hl + ^^'42)^2 + i9''h2 + 9^^h2)h2 = -9'\hlh2 - ^12)- 

Since by an earlier remark (13.3.8), 

det(£) £11^22 - 



K 



det(^) ^11^22 - 9i2 



2 ' 



A'3^'32 - ^'l'3^'32 = -9^\M22 - ^?2) = -^"(^11^22 - ^^2)^^ 

and the claimed formula for K follows. ■ 



14.2.2 The Fundamental Theorem of Surfaces. Congruent parametric surfaces in 
R"^ have the same First and Second Fundamental Forms and conversely two parametric sur- 
faces in R"^ with the same First and Second Fundamental Forms are congruent. Moreover, 
if O is a domain in R^ and I = Ylfj^i gij dti dtj, II — Ylfj^i £ij dti dtj are quadratic 
forms in O with I positive deGnite, then there exists a parametric surface T : O ^ R^ 
with 1-^ = 1 and II''^ = II provided the Gauss-Codazzi equations are satished. 

PROOF. We have already discussed the first statement. If J^^ : O ^ R^, z = 1,2 have 
the same First and Second Fundamental forms, then after translations we can assume that 
they both map some point p E O to the origin. Then, since J-'l_ (p) ■ T}. (p) = Qij (p) = 
J'f.{p) ■ J-^.{p), it follows that after transforming one of the surfaces by an orthogonal 

transformation we can assume that the standard frame f ^ for JF^ and the standard frame 
f for 

agree at p. But then, since JF^ and JF^ have identical frame equations, by the 
uniqueness part of the Frobenius Theorem it follows that f and f agree in all of (9, so in 
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particular T}. = !F^.. But then and T'^ differ by a constant, and since they agree at p, 
they are identical, proving the second statement. 

To prove the third and final statement of the theorem, we first note that since Qij is 
positive definite, it is in particular invertible, so the matrix and the matrices P'^ of 
Theorem 14.1.3, are well-defined. Moreover, since the Gauss-Codazzi equations are just 
the compatibility conditions of Frobenius Theorem, it follows that we can solve the "frame 
equations" f = f ^ k — 1,2 uniquely given an arbitrary initial value for f at some point 
p G O, and for this initial frame we choose a basis f (p) for such that fi{p)-fj{p) = Gij{p) 
(which is possible since Qij and hence Gij is positive definite). 

Having solved for the frame field f , we now need to solve the system JF^. = f j, i = 1, 2 to get 
the surface : (9 — > R^. This is another Frobenius problem, and now the compatibility 
condition is {ji)t2 = (f2)ti by the frame equation, Yl^=iPjifj = Yl^=iPj2fj- 
by inspection, the second column of P^ is indeed equal to the first column of P^, so 
the compatibility equations are satisfied and we can find a unique T with J^(p) = and 
^ti = fi, for i = 1,2. 

It remains to show that JF is a surface in R"^ with Yliij 9ijdtidxj and Yliij^ijdtidtj as its 
first and second fundamental forms, i.e., 

• Tt^ and independent, 

• f3 is orthogonal to and Tt^i 

• Ilf3ll = l, 

• J^u -^tj = 9iji and 

• (fs)^, ■ fxj = 

The first step is to prove that the 3x3 matrix function $ = (f ^ • f^) is equal to G. We 
compute the partial derivatives of Since f satisfy the frame equations, 

= ^kifk • fj + Pkjfk ■ fi = PkiQjk + gikPkj 

k k 

= {GP^),, + (GPI)., = {GP' + {GP^Y)i:i. 

But GP^ = G{G~^A^) = A^, so = Gt^ and a similar computation gives $t2 = Gt^. 
Thus $ and G differ by a constant, and since they agree at p they are identical. Thus 
f j • fj = Gij, which proves all of the above list of buUeted items but the last. 
To compute the Second Fundamental Form of we again use the frame equations: 

-(f 3)ti • h = (a^'hi + 9'^ii2)fi ■ fj + {g^Hii + /'42)f2 • fi 

= hlSlj +il2S2j- 

So "(fs)*! 'fi = "(fs)*! ■f2 = '^12, and similar computations show that —{^2)12 'fj = 

£2j, proving that ^ - • £ijdti dtj is the Second Fundamental Form of T. ■ 
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The Eighth and Final Matlab Project. 



The primary Matlab M-File should be called SurfaceFT.m and should start out: 
function F = SurfaceFT(gll,gl2,g22,lll,112,122,al,bl,a2,b2,TlRes,T2Res) 
where / := gij ,t2) dti dtj and // := X^^^ lij (tl ,t2) dti dtj are quadratic 

forms in O, and the function F : O ^ returned is supposed to be the surface having / 
and // as its First and Second Fundamental Forms. For this surface to exist, we know from 
the Fundamental Theorem that it is necessary and sufficient that / be positive definite and 
that the Gauss-Codazzi equations be satisfied. 

Of course the heavy lifting of the SurfaceFT will be done by AlgorithmF (i.e., the solution 
of the Probenius Problem) which you will apply to integrate the frame equations in order 
to get the frame field f — after which you must apply AlgorithmF a second time to get the 
surface from and f2- 

But to carry out the first application of AlgorithmF, you must first compute the matrices 
= G~^A^ and = G~^A'^ that define the right hand sides of the two frame equations. 
Recall that is the inverse of the 3x3 matrix 

/gll(tl,t2) gl2(tl,t2) O' 
G= gl2(tl,t2) g22(tl,t2) 
V 1 

and so it can be easily computed from the gij(tl,t2) by using Cramer's Rule, while 
the two 3x3 matrices and A'^ are given explicitly (sec 14.1.3 above) in terms of the 
gll(tl,t2) and their partial derivatives with respect to the U . (Of course, once 
you have both G~^ and A*, you get P* as their matrix product.) 

In order to be able to compute the A*, you will first need to define some auxilliary functions. 
Most of them can probably be subfunctions defined in the same file, though some could 
be separate M-Files. For example you will want to have a function called g(tl,t2) that 

' , . ' „N I and another called l(tl,t2) that 

gl2(tl,t2) g22(tl,t2) J 

_ _ ^. /lll(tl,t2) 112(tl,t2)\ V -iw, ^ 

returns a 2 x 2 matrix , , , , - You will then want to create the 

\^112(tl,t2) 122(tl,t2) J 

functions G(tl,t2) and invG(t2,t2) that return the 3x3 matrices G and G 



-1 



There is another complication before you can define the Matlab functions Al and A2 that 
represent A^ and A^. You not only need the functions gij(tl,t2) but also their first 
partial derivatives with respect to the variables tl and t2. I recommend that along with 
the function g(tl,t2) you also define two more functions g_tl(tl,t2) and g_t2(tl,t2) 
that return 2x2 matrices whose entries are the partial derivatives of the gij (tl ,t2) with 
respect to tl and t2 respectively. As usual you can compute these partial derivatives using 
symmetric differencing — you don't need to do it symbolically. 

You should define a Matlab function GaussCodazziCheck that will check whether or not 
the Gauss-Codazzi Equations are satisfied. Once you have defined the two 3x3 matrix- 
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valued functions and P^, it will be easy to write GaussCodazziCheck, since the Gauss- 
Codazzi equations are just P/^ ~ ^ti = P^P^ — P^P^ ■ The idea is to check the identities 
numerically, matrix element by matrix element, at a sufficiently dense set of points, again 
using symmetric differencing to compute the derivatives. 

Of course, when you are all done you will need some good test cases on which to try out 
you algorithm. We will discuss this elsewhere. 

GOOD LUCK, AND HAVE FUN! 
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The Matlab Projects 
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> Project 1. Implement Gram-Schmidt as a Matlab 
Function 

In more detail, create a Matlab m-file GramSchmidt.m in which you define a Matlab 
function GramSchmidt(M) taking as input a rectangular matrix M of real numbers of 
arbitrary size m x n, and assuming that the m rows of M are linearly independent, it 
should transform M into another m x n matrix in which the rows are orthonormal, and 
moreover such that the subspace spanned by the first k rows of the output matrix is the 
same as the space spanned by the first k rows of the input matrix. Clearly, in writting 
your algorithm, you will need to know the number of rows, m and the number of columns 
n of M. You can find these out using the Matlab size function. In fact, size(M) returns 
(m,n) while size(M,l) returns m and size(M,2) returns n. Your algorithm will have to do 
some sort of loop, iterating over each row in order. Be sure to test your function on a 
number of different matrices of various sizes. What happens to your function if you give 
it as input a matrix with linearly dependent rows. (Ideally it should report this fact and 
not just return garbage!) 

Addenda 

• The project is a little ambiguous. It asks for a function M-File that transforms the 
input matrix to a matrix with orthogonal rows. One legitimate interpretation (actually 
the one I had in mind) was that the input matrix should actually be changed by the 
function into one with orthogonal rows. However, if you prefer to write your function 
so that it does not actually change the input matrix but it instead returns a different 
matrix having orthogonal rows, that is acceptable. (But you should realize that there 
are often good reasons to do the orthogonalization "in place" . For example, if the input 
matrix is very large (e.g., 10000 x 10000) then there might be a memory problem in 
creating a second matrix of that size.) 

• Please put your name in a comment near the top of the M-File. 

• Another comment (coming just after the line declaring the function) should explain 
in detail just what the function does and how to call it. This will be printed in the 
command window when a user types "help GramSchmidt" . 

• Several of you have asked how to handle the problem of an input matrix in which the 
rows are not linearly independent. You will detect this in the course of the computation 
by finding that the norm of a certain vector u is zero, so you cannot normalize u to get 
the next element of the orthonormal set. (By the way, you should be careful to check not 
just for \\u\\ being exactly zero, but say for < 0.00001. The reason is that because 
of roundoff and other errors the computation will be too unreliable if the vectors are 
"almost linearly dependent".) In this case you should not try to return any matrix and 
should just use the disp() function to display an error string to tell the user about the 
problem. Something like: 

disp(' Input matrix rows are dependent; orthonormalization impossible.') 
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> Project 2. Implement the Trapezoidal Rule 
and Simpson's Rule in Matlab 



0.1 Review of Trapezoidal and Simpson's Rules. 

One usually cannot find anti-derivatives in closed form, so it is important to be able 
to "evaluate an integral numerically" — meaning approximate it with arbitrary precision. 
In fact, this is so important that there are whole books devoted the study of numerical 
integration methods (aka quadrature rules). We will consider only two such methods, the 
Trapezoidal Rule and Simpson's Rule. In what follows, we will assume that the integrand 
/ is always at least continuous. 

0.1.1 Definition. By a quadrature rule we mean a function M that assigns to each 
continuous function f : [a,b] ^ V (mapping a closed interval [a, b] into an inner-product 
space V) a vector M{ f, a, b) G V — which is supposed to be an approximation of the 
integral, J f{t) dt. A particular quadrature rule M is usually given by specifying a linear 
combination of the values of / at certain points of he interval [a, 6]; that is, it has the 
general form M{f,a,b) :— '^^^iWif{ti), where the points ti G [a, 6] are called the nodes 
of M and the scalars Wi are called its weights. The error of M for a particular / and [a, b] 

is defined as Err(M, /, a, b) := f{t) dt - M{f, a, b) 

0.1— Example 1. The Trapezoidal Rule: M^{f,a,b) := ^[/(a) + f{b)]. 
In this case, there are two nodes, namely the two endpoints of the interval, and they have 
equal weights, namely half the length of the interval. Later we shall see the origin of this 
rule (and explain its name). 

0.1— Example 2. Simpson's Rule: M^(/, a, b) := ^[/(a) + 4/(^) + /(6)]. 

So now the nodes are the two endpoints, as before, and in addition the midpoint of the 

interval. And the weights are for the two endpoints and for the midpoint. 

0.1.2 Remark. Notice that in both examples the weights add up to one. This is no 
accident; any "reasonable" quadrature rule should have a zero error for a constant function, 
and this easily implies that the weights must add to one. 

0.1.3 Proposition. If f : [a,b] ^ V has two continuous derivatives, and \\f"{t)\\ < C 
for all t G [a,b] then Err(M^, /, a, 6) < C^^=|^. Similarly, if f : [a,b] V has four 
continuous derivatives, and ||/""(t)|| < C for aU t G [a, b] then Err(M^, /, a, b) < C^^^^ 

0.1.4 Remark. The proof of this proposition is not difficult — it depends only the Mean 
Value Theorem — but it can be found in any numerical analysis text and will not be repeated 
here. 

0.1.5 Definition. If M is a quadrature rule then we define a sequence M„ of derived 
quadrature rules by M^if, a, b) := Yll=o -^(/^ a + ih,a + {i + l)h) where h = We 
say that the rule M is convergent for / on [a,b] if the sequence Mn{f,a,b) converges to 
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In other words, to estimate the integral f(t) dt using the n-th derived rule M„, we simply 
divide the interval [a, b] of integration into n equal sub-intervals, estimate the integral on 
each sub-interval using M, and then add these estimates to get the estimate of the integral 
on the whole interval. 

0.1.6 Remark. We next note an interesting relation between the errors of M and of M^. 

Namely, with the notation just used in the above definition, we see that by the additivity 
of the integral, f{t) dt = la+ih^^''^ ■^(^) hence from the definition of M„ and 

the triangle inequality, we have Err(M„, /, a, b) < Yl7=o Err(M, f,a + ih,a + {i + l)h). We 
can now use this together with Proposition 7.4.3 to prove the following important result: 

0.1.7 Theorem. If f : [a,b] ^ V has two continuous derivatives, and ||/"(^)|| < C for 
all t G [a, b] then Err (Mj, /, a,b) < C . Similarly, if f : [a,b] ^ V has four continuous 
derivatives, and \\f""{t)\\ < C for all t e [a, b] then Err(M^, /, a, b) < C^^^ 

0.1.8 Remark. This shows that both the Trapezoidal Rule and Simpson's Rule are con- 
vergent for any reasonably smooth function. But it also shows that Simpson's Rule is far 
superior to the Trapezoidal Rule. For just fifty per cent more "effort" (measured by the 
number of evaluations of /) one gets a far more accurate result. 



The second Matlab project is to develop Matlab code to implement the Trapezoidal Rule 
and Simpson's Rule, and then to do some experimentation with your software, checking 
that the error estimates of theorem 7.4.7 are satisfied for some test cases where the function 
/ has a known anti-derivative and so can be evaluated exactly. In more detail: 

1) Write a Matlab function M-file defining a function TrapezoidalRule(f,a,b,n). This should 
return the value of Mj(/, a, 6). Here of course the parameters a and b represent real 
numbers and the parameter n a positive integer. But what about the parameter f, i.e., 
what should it be legal to substitute for f when the TrapezoidalRule(f,a,b,n) is called? 
Answer: f should represent a function of a real variable whose values are arrays (of 
some fixed size) of real numbers. The function that you are permitted to substitute for 
f should either be a built-in Matlab function (such as sin) or an inline function in the 
Matlab Workspace, or a function that is defined in some other M-File. 

2) Write a second Matlab function M-file defining a function SimpsonsRule(f,a,b,n) that 
returns M^(/, a, b). 

3) Recall that = arctan(t), so that in particular = 4arctan(l) = tt. Using 
the error estimates for the Trapezoidal Rule and Simpson's Rule, calculate how large n 
should be to calculate tt correct to d decimal places from this formula using Trapezoidal 
and Simpson. Set format long in Matlab and get the value of tt to fifteen decimal places 
by simply typing pi. Then use your Trapezoidal and Simpson functions from parts 1) 
and 2) to see how large you actually have to choose n to calculate tt to 5, 10, and 15 
decimal places. 

4) Be prepared to discuss your solutions in the Computer Lab. 
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> Project 3. Implement the Method of 

Successive Approximations 

0.2 Review of The Contraction Principle. 

If X is any set and / : X — > X a mapping of X to itself, then for each positive integer n we 
define a mapping /'"^X — > X by composing / with itself n times. That is, /'^^ (x) = f{x), 
f''^\x) = f{f{x)), f'^'^\x) = /(/(/(x))), etc. To be more formal, we define the sequence 
/ inductively by: / := / and / '■= J ° J 
Elsewhere you have verified the following facts: 

1) / o/ =/ 

2) If X is a metric space and that / satisfies a Lipschitz condition with constant K then 

(n) 

f satisfies a Lipschitz condition with constant K^. 

3) Assuming again that X is a metric space and that / : X — > X is a contraction mapping, 
i.e., that / satisfies a Lipschitz condition with constant X < 1, we have the so-called 
Fundamental Inequality For Contraction Mappings, namely, for all xi,X2 G X, 



p{xi,X2) < (^P{xi,f{xi)) + p{x2, f{x2)^ ■ 



4) With the same assumptions, if x is any point of X then 



5) If / : X — X is a contraction mapping and p is the unique fixed point of /, then for 
any x in X, p{f"\x),p) < p{x, f{x)) 

Remark. The sequence {/'^ \x)} is usually referred to as the sequence of iterates of x 
under f, and the process of locating the fixed point p of a contraction mapping / by 
taking the limit of a sequence of iterates of / goes by the name "the method of successive 
approximations" . To make this into a rigorous algorithm, we must have a "stopping 
rule". That is, since we cannot keep iterating / forever, we must know when to stop. 
One rather rough approach is to keep on iterating until successive iterates are "close 
enough", but a better method is provided by the previous problem. Suppose we decide 
to be satisfied with the approximation \x) if we can be sure that p{/ \x),p) < e 
where e is some "tolerance" given in advance. We first compute f{x), then p{f{x),x), and 

then solve (^jzk^ p{x, f{x)) = e for n and iterate n — 1 more times to get our acceptable 
approximation ' (x) to p. 

6) Solve ^i^k) p{xif{x)) = e for n in terms of e, and p{x,f{x)). 
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Third Matlab Project. 

Write an Matlab M-file that implements the Successive Approximations algorithm. Name it 
SuccessiveApprox.m, and use it to define a Matlab function SuccessiveApprox(/, K, x, eps). 
Assume that / : R"^ R"^ is known to be a contraction mapping with contraction constant 
K, that X G R"^, and you want to compute iterates of x until you are within eps of the 
fixed point p of /. Use a subfunction to compute the number of times n you need to iterate 
/ starting from x to get within eps of p, and then use a loop and feval to iterate applying 
/ to X the appropriate number of times. 
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> Project 4. Implement Euler's Method 
and Runge-Kutta in Matlab 



0.3 Review of Stepping Methods for Solving IVPs. 

In what follows X is a C"*^ time-dependent vector field on V, and given to in R and 
in V we will denote by a{X,x^ ,to,t) the maximal solution, x{t), of the differential 
equation jjj = X{x,t) satisfying the initial condition x{to) = x'^. The goal in the numerical 
integration of ODE is to devise effective methods for approximating x{t) on an interval 
/ = [^0)2^]- The strategy that many methods use is to interpolate N equally spaced 
gridpoints ti, . . An in the interval /, defined by := to + kAt with At = , and then 
use some rule to define values s^, . . . , x^ in V, in such a way that when is large each 
x'^ is close to the corresponding x{tk)- The quantity maxi<fc<Ar ^x^ — x{tk)\\ is called the 
global error of the algorithm, and if it converges to zero as N tends to infinity (for every 
choice of X, to ) 3;°, and T), then we say that we have a convergent algorithm. 

One common way to construct the algorithm that produces the values x^,. . . uses a 
recursion based on a so-called "stepping procedure", namely a function, a;°, to, '^i), 
having as inputs: 

1) a time-dependent vector field X on F, 

2) an initial condition in V ^ 

3) an initial time to in and 

4) a "time-step" At in R, 

and with output a point of V that for small At approximates cr(X, a;°, to, to + At) well. 
More precisely, the so-called "local truncation error" , defined by 



should approach zero at least quadratically in the time-step At. Given such a step- 
ping procedure, the approximations x^ of the x{tk) are defined recursively by x^^^ = 
E(X, x'^, tfc. At). Numerical integration methods that follow this general pattern are re- 
ferred to as finite difference methods. 



0.3.1 Remark. There are two sources that contribute to the global error, llx^ — x{tk 



First, each stage of the recursion will give an additional local truncation error added to 
what has already accumulated up to that point. But, in addition, after the first step, 
there will be an error because the recursion uses x^,tk, At) rather than the unknown 
x(tfc), tfe. At). (In practice there is a third source of error, namely machine round-off 
error from using floating-point arithmetic. We will usually ignore this and pretend that our 
computers do precise real number arithmetic, but there are situations where it is important 
to take it into consideration.) 



(j(X, to, to + At) - S(X, to, At) II , 
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For Euler's Method the stepping procedure is simple and natural. It is defined by: 
Euler Step 

E^(X,x^,to,At) := + AtX{x^,to). 

It is easy to see why this is a good choice. If as above we denote (t(X, to, by x{t), 
then by Taylor's Theorem, 

x{to + At) ^x{to) + Atx'ito) + 0{Af) 
= xV AtX(x°,to) + 0(At2) 

= E^{X,x^,to,At)+0{At^), 

so ||cr(X, x'^^to^to + At) — a;°, to: At)||, the local truncation error for Euler's Method, 
does go to zero quadratically in At. When we partition [0, T] into N equal parts. At = 
, each step in the recursion for computing x^ will contribute a local truncation error 
that is 0{At^) = 0{^). Since there are N steps in the recursion and at each step we 
add 0{^) to the error, this suggests that the global error will be 0{j^), and hence will 
go to zero as N tends to infinity, and this can be proved rigorously, so Euler's Method is 
convergent. 

One excellent general purpose finite difference method for solving I VPs, and it goes by 
the name Runge-Kutta — or more properly the fourth order Runge-Kutta Method — since 
there is a whole family of Runge-Kutta methods. The stepping procedure for fourth order 
Runge-Kutta is: 

Runge-Kutta Step 

E^^\x,xo,to,At) := xo + l{ki + 2k2 + 2k3 + k4), where: 

ki =AtX{xo,to) 
k2^AtX{xo+lki,to + ^) 

k3 = AtX{xo + lk2,to + ^) 
k^ = AtX{xo + ks,to + At) 

Runge-Kutta is fourth order, meaning that the local truncation error goes to zero as the 
fifth power of the step-size, and the global error as the fourth power. So if for a fixed step- 
size we have attained an accuracy of 0.1, then with one-tenth the step-size (and so ten 
times the number of steps and ten times the time) we can expect an accuracy of 0.00001, 
whereas with the Euler method, ten times the time would only increase accuracy from 0.1 
to 0.01. 

Fourth Matlab Project. 

Write a Matlab M-File function Euler (X,xO,T,n) that estimates x{T), the solution at 
time T of the initial value problem ^ = X(x), x(0) = xO by applying the Euler step- 
ping method to the interval [0, T] with n time steps. Similarly write such a function 
RungeKutta(X,xO,T,n) that uses the Runge-Kutta stepping method. Make some exper- 
iments using the case V — W ~ with xO — 1 and T — 1, so that x{T) — e. Check 
how large n has to be to get various degrees of accuracy using the two methods. 
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> Project 5. Frobenius Theorem and Algorithm F 

In this project you will develop a Matlab implementation of what we call Algorithm F. 
First we recall the mathematics behind the algorithm. We start with two vector fields 
and X'^ on that depend on two real parameters ti and t2- That is, for i = 1,2, X* is 
a map (assumed to be C'' with > 2) of x ^ R'", 

{Xi,..., Xn, ti,t2) ^ {Xl{xi, . . . , Xn, ^1,^2), . . . , (xi , . . . , 0;^, ^1,^2)) 

and our goal is to solve a certain initial value problem (*) on a rectangle r in R^ given by 
r := {(^1,^2) G R^ \ CLi < ti < bi, i = 1, 2}. This means that we are looking for a function 
3^(^17 ^2) R" defined on r that has an assigned "initial value" G R"^ at the "bottom 
left corner" (ai, of r and that satisfies the two first order partial differential equations 
§f:^X'{x,ti,t2),foTi = l,2: 

1) x(ai, 02) = x^, 
(*) 2) ^^^X\x,h,t2), 

3) ^=X2(x,ti,t2), 

Algorithm F for Constructing Solutions of the System (*). 

We next describe the algorithm that we will refer to as Algorithm F for constructing the 
solution x{ti,t2) to (*) in r provided a solution exists. The algorithm will produce a map 
(^1,^2) ^ x{ti,t2), defined in r and for which the following five statements a) to e) are 
valid: 

a) x{ti,t2) satisfies the initial value condition 1) of (*), 

b) x{ti, t2) satisfies 2) of (*), along the line t2 = a2 (i.e., the bottom edge of r) . 

c) a;(ti, ^2) satisfies 3) of (*) in all of r, 

d) X :r is C", 

e) The properties a), b), c) uniquely determine the function x{ti,t2) in r, hence it will be 
the unique solution of (*) in r if a solution exists. 

The strategy behind Algorithm F comes from a change in point of view. Instead of re- 
garding 2) and 3) of (*) as a pair of coupled PDE for x{ti,t2) with independent variables 
ti and t2, we consider them as two independent ODEs, the first with ti as independent 
variable and t2 as parameter, and the second with these roles reversed. 

In more detail, we first we solve the initial value problem ^ = X^(?/, i, i^) and y{ai) = x^ 
on [ai,6i] and define a;(t,a2) = y{t) for ai < t < 61 . This makes statements a) and b) 
true, and moreover, by the uniqueness of solutions of the IVP for ODEs, conversely if a) 
and b) are to hold then we must define x{t, 02) this way for t in [ai, bi]. 



83 



Math 32a Fall 2003 



R. Palais 



Then, for each ti e [ai, 61] we define x{ti,t) for 02 < t < 62 as follows. Wc note that x{t, 02) 
has already been defined in the preceding step, so we solve the IVP g = X'^{z,ti,t) and 
z{a2) = x{t,a2) and define x{ti,t) = z{t) for t G [02,62]- This extends the definition of 
x(ti,t2) to the remainder or r, and it clearly is the unique definition that will make c) 
valid. 

[That completes the formal description of Algorithm F. We now restate it in less formal 
and more intuitive language. First find a;(ti, ^2) along the line ^2 = 02 by freezing the value 
of t2 at a2 and regarding the partial differential equation ^ = X^{x,ti,t2) as an ODE 

in which t2 is just a parameter. Then, regard the PDE ^ = X'^{x,t\,t2) as an ODE in 
which ti is a parameter, and for each parameter value ti in ai, hi] solve this ODE, taking 
for initial value at t2 = 0,2 the value x{ti, 02), found in the first step.] 

Remark As we saw in the lecture notes, the function x(ti,t2) produced by Algorithm 
F does not necessarily satisfy 2) of (*) except along the line ^2 = o-2 (where it does 
by construction). On the other hand we saw that by exploiting the "equality of cross- 
derivatives" principle we could develop a simple condition on the two vector fields 
and (that we called "compatiblity" ) that turned out to be a necessary and sufficient 
condition for Algorithm F to always produce a solution of (*). Here is the definition: 

0.3.2 Definition. Let X^ :IC xB? ^ and : R'^ x R^ ^ R"" be vector fields 
on R"' depending on two real parameters ti and t2- We will call X^ and X"^ compatible if 
the following n conditions hold identically: 



The fact that compatibility is necessary and sufficient for the output of Algorithm F to be 
a solution of the IVP (*) for all choices of initial conditions is the content of the Frobenius 
Theorem. 



Your assignment for the fifth project is to implement Algorithm F in Matlab. This should 
consist of an M-File, AlgorithmF.m, defining a Matlab function AlgorithmF(Xl,X2,...), 
together with various auxilliary M-Files that implement certain subroutines required by 
the algorithm. (As usual, it is a matter of programming taste to what extent you use 
subfunctions as opposed to functions defined in separate M-Files.) 

Let's consider in more detail just what the inputs and output to AlgorithmF should be. 
First, the output, x, should represent the function x{ti,t2) that solves the IVP (*). Since 
we are going to get this solution by solving some ODEs numerically (using Runge-Kutta) , 
in Matlab x will be a two-dimensional array x(i,j) of vectors of length n, 

function x = AlgorithmF (XI , X2 , xO , al , a2 , bl , b2 , . . . ) 




l<i<n. 



0.4 Fifth Matlab Project. 
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The size of the output array x will be given by two positive integers, TlRes and T2Res 
that specify the number of subintervals into which we divide the intervals [al,bl] and 
[a2,b2]. Let's define hi := (bl - al)/TlRes and h2 := (b2 - a2)/T2Res. We take TlRes 
+ 1 subdivision points in [al,bl], al + i * hi, i = 0,1, TlRes, and similarly we take 
T2Res + 1 subdivision points [a2,b2], a2 + j * h2, j = 0,1, T2Res, It will be convenient 
to store these in arrays Tl and T2 of length TlRes + 1 and T2Res + 1 respectively. That 
is, Tl(i) = al + i * hi and T2(i) = a2 + i * h2. Then the array x(i,j) will have size 
TlRes + 1 by T2Res + 1. We will store at x(i,j) the approximate value of the solution 
x{ti,t2) of (*) at the point (Tl(i),T2(j)), found by solving the ODEs we mentioned using 
Runge-Kutta. So now the first line of our M-File has become: 

function x = AlgorithmF (XI , X2 , xO , al , a2 , bl , b2 , TlRes , T2Res , . . . ) 

We need one more input parameter, namely a real number StepSize to control the accuracy 
of the Runge-Kutta algorithm. StepSize is not the actual size of the steps used in the 
Runge-Kutta integration, but rather an upper bound for it. When we propagate the 
solution of an ODE y(t) from a value t = tO where we already know it to a next value t = 
to -|- h where we need it, we will divide h in a number N of equal steps to make h/N less 
than StepSize and use that many steps in our Runge-Kutta method. (Since we will usually 
settle for accuracy of about 10~^ and Runge-Kutta is fourth order, in practice we usually 
take StepSize approximately 0.01). So finally the first line of our M-File has become: 

function x = AlgorithmF (XI, X2,x0,al,a2,bl,b2, TlRes, T2Res, StepSize) 

The first two input parameters XI and X2 represent the vector fields defining the system 
of PDE we are deahng with. Each is a function of n -|- 2 variables, xl, x2,...,xn,tl,t2. In 
practice the actual functions substituted for these parameters will be taken from functions 
defined either in an M-File or an inline expression. 

Writing and Testing the Algorithm F Code 

Once you understand the above discussion well you should find it straightforward to ac- 
tually write the code for AlgorithmF. Start by assigning to x(0,0) the value xO, Then, for 
i = to TlRes, inductively find x(i-|-l,0) from x(i,0) by using Runge-Kutta to solve the 
ODE ^ = Xl{x,tl,a2) on the interval [Tl(i),Tl(i+l)] with initial value x(i,0) at time 
tl = Tl(i). Then, in a similar manner, for each i from to TlRes, and each j from to 
T2Res, inductively find x(i,j-|-l) from x(i,j) by applying Runge-Kutta to solve the ODE 
§^ =X2(x,Tl(i),t2) on the interval [T2(j),T2(j+l)] with initial value x(i,j) at time t2 = 
T2(j). 

After the solution array x is constructed, it should be displayed either in wireframe (using 
meshgrid) or in patch mode (using surf). 

Here is an "extra credit" addition to Project 5. Write an M-File defining a function to 
checks whether the two vector fields XI and X2 are compatible. I suggest that you do this 
by checking numerically whether the two sides of the n compatibility conditions are equal 
at the points (Tl(i),T2(j)). Here, to allow for roundoff errors, "equal" should mean that 
the absolute value of the difference is less than some tolerance. Use centered differences to 
compute the partial derivatives. See if you can make your test of equality "scale invariant" . 
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This means that if it succeeds or fails for XI and X2, it should do the same if you multiply- 
both XI and X2 by the same scalar. 

Algorithm F Test Case 

As you probably realize by now, in order to have confidence in the correctness of computer 
programs, it is important to test them carefully — and in order to test them, one needs 
inputs for which the correct output is known. Since it may not be not entirely obvious 
how to construct a good test case for Algorithm F, let me suggest one possibility. 

Recall that the spherical polar coordinates of a point x in R"^ with cartesian coordinates 
{xi,X2,xs) are defined by r := \\x\\, cf) := tan~-'^(a;2/a;i) 9 := cos~^(x3/r). In the other 
direction, xi = r sin(^) cos(0), X2 = r sin(^) sin(0), and z := rcos{d). 

Let's use ti to denote the colatitude 6 and t2 to denote the longitude </>. Then we get a 
parametrization of the sphere through a point x and centered at the origin, by (ti,t2) ^ 
\\x\\ (sin(ti) cos(t2)5sin(ti)sin(t2),cos(ti)), with < < tt, and < ^2 < 27r. 

If we now differentiate with respect to ti and we find that these par ametrizat ions of 
the family of spheres centered at the origin are solutions of the first order system of PDE: 

X\x,tut2), 
X\x,ti,t2), 

where and A^ are the maps x R^ R^ given by: 

X^{x,ti,t2) := \\x\\ (cos(ti) cos(t2), cos(ti) sin(t2), — sin(ti)), 

A^(a;,ti,t2) H^^H (— sin(ti) sin(t2), sin(ti) cos(t2), 0). 

When you have finished defining AlgorithmF and want to test it, try it with this choice of 
XI and X2, and use (0,0, r) as an initial condition at time tl = t2 = 0. If you display the 
solution X using meshgrid, you should see a sphere of radius r displayed with latitude and 
longitude gridlines. 



ox 
dx 
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This Matlab project is concerned in part with the visualization and animation of curves. 
Before getting into the details of the project, I would like to make a few general remarks 
on the subject of mathematical visualization that you should keep in mind while working 
on this project — or for that matter when you have any programming task that involves 
visualization and animation of mathematical objects. 

1) How should you choose an error tolerance? 

First, an important principle concerning the handling of errors in any computer graphics 
context. Books on numerical analysis tell you how to estimate errors and how to keep 
them below a certain tolerance, but they cannot tell you what that tolerance should be — 
that must depend on how the numbers are going to be used. Beginners often assume they 
should aim for the highest accuracy their programming system can provide — for example 
fourteen decimal places for Matlab. But that will often be far more than is required for 
the task at hand, and as you have already seen, certain algorithms may require a very long 
time to attain that accuracy. The degree of one's patience hardly seems to be the best 
way to go about choosing an error tolerance. 

In fact, there is often is a more rational way to choose appropriate error bounds. For 
example, in financial calculations it makes no sense to compute values with an error less 
than half the smallest denomination of the monetary unit involved. And when making 
physical calculations, it is useless to calculate to an accuracy much greater than can be 
measured with the most precise measuring instruments available. Similarly, in carpentry 
there is little point to calculating the length of a board to a tolerance less than the width 
of the blade that will make the cut. 

This same principle governs in mathematical visualization. My approach is to choose a 
tolerance that is "about half a pixel" , since any higher accuracy won't be visible anyway. 
It is usually fairly easy to estimate the size of a pixel. There are roughly 100 pixels per 
inch, so for example if you are are graphing in a six inch square window, and the axes go 
from minus one to one, then six hundred pixels equals two length units, so half a pixel 
accuracy means a tolerance of or roughly 0.002. 

1) How should you represent a curve? 

Mathematically a curve in R"' is given by a map of an interval [a, b] into R"^. We can only 
represent the curve on a computer screen when n = 2 or n = 3. Let's consider the case of 
plane curves (n = 2) first. If a{t) — {x{t),y{t)) then for any N we can divide the interval 
[a, 6] into N equal subintervals of length h = namely where tk = a + kh 

and k = 0,. . . ,N{—1. We associate to a and N an approximating 'W-gon" aN (i.e., a 
polygon with N sides) with vertices Vk '■= {x{tk),y{tk))- It is some ctjv with suitably 
large) that actually gets drawn on the computer screen when we want to display a. This 
reduces the actual drawing problem to that of drawing a straight line segment, and the 
latter is of course built into every computer system at a very low level. 

In Matlab the code for plotting the curve a, or rather the polygon ctso would be: 
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N = 30 

h = (b-a)/N; 
t = a:h:b ; 

plot (x(t) ,y (t) ) , axis equal; 

To plot a curve a{t) — {x(t),y{t), z{t)) in R"^ is really no more difficult. In Matlab the 
only change is that the last line gets replaced by: 
plot3(x(t) ,y(t) ,z(t) ) , axis equal; 

only now one has to be more careful about interpreting just what it is that one sees on the 
screen in this case. The answer is that one again is seeing a certain polygon in the plane, 
but now it is the projection of the polygon in with vertices at Vk '■= {x{tk) , y{tk) , z{tk)) ■ 
(The projection can be chosen to be either an orthographic projection in some direction 
or else a perspective projection from some point.) 

1) How do you create animations? 

Viisualization can be a powerful tool for gaining insight into the nature of complex math- 
ematical objects, and frequently those insights can be further enhanced by careful use of 
animation. Remember that time is essentially another dimension, so animations allow us 
to pack a lot more information onto a computer screen in a format that the human brain 
can easily assimilate. The number of ways that animation can be used are far to numer- 
ous to catalog here, but in addition to obvious ones, such as rotating a three dimensional 
object, one should also mention "morphing". Mathematical objects frequently depend on 
several parameters (e.g., think of the family of ellipses: x = acos(^), y = bsm{d)). Mor- 
phing refers to moving along a curve in the space of parameters and creating frames of an 
animation as you go. 

All animation techniques use the same basic technique — namely showing a succession of 
"frames" on the screen in rapid succession. If the number of frames per second is fast 
enough, and the change between frames is small enough, then the phenomenon of "persis- 
tence of vision" creates the illusion that one is seeing a continuous process evolve. Com- 
puter games have become very popular in recent years, and they depend so heavily on 
high quality animation that the video hardware in personal computers has improved very 
rapidly. Still, there are many different methods (and tricks) involved in creating good 
animations, and rather than try to cover them here we will have some special lectures 
on various animation techniques, with particular emphasis on how to implement these 
techniques in Matlab. 

Matlab Project # 6. 

Your assignment for the sixth project is to implement the Fundamental Theorem of Plane 
Curves using Matlab. That is, given a curvature function k : [0, L] R, construct and 
plot a plane curve x : [0, L] — > R^ that has k as its curvature function. To make the 
solution unique, take the initial point of x to be the origin and its initial tangent direction 
to be the direction of the positive a;-axis. You should also put in an option to plot the 
evolute of the curve as well as the curve itself. Finally see if you can build an animation 
that plots the osculating circle at a point that moves along the curve x. For uniformity, 
name your M-File PlaneCurveFT, and let it start out: 



88 



Math 32a Fall 2003 



R. Palais 



function x = PlaneCurveFT(k,L,option) 

If option is not given (i.e., nargin = 2) or if option = 0, then just plot the curve x. If 
option = 1, then plot x and, after a pause, plot its evolute in red. Finally, if option = 
2, then plot x and its evolute, and then animate the osculating circle (in blue) along the 
curve, also drawing the radius from the center of curvature. 

[To find the curve x, you first integrate k to get = x' , and then integrate T^. The 
curvature, k, will be given as a Matlab function, so you can use the version of Simpson's 
Rule previously discussed for the first integration. But ~t will not be in the form of a 
Matlab function that you can substitute into that version of Simpson's Rule, so you will 
need to develop a slightly modified version of Simpson's, where the input is a matrix that 
gives the values of the integrand at the nodes rather than the integrand as a function.] 
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> Project 7. Fundamental Theorem of Space Curves 



Your assignment for the seventh Matlab project is to implement the Fundamental Theorem 
of Space Curves. That is, given a (positive) curvature function k : [0, L] — R, and a torsion 
function r : [0, L] — > R, construct and plot a space curve x that has k as its curvature 
function and r as its torsion function. To make the solution unique, take the initial point of 
X to be the origin and its initial tangent direction to be the direction of the positive x-axis. 
You should also use plot3 to plot the curve. See if you can create an animation that moves 
the Prenet Frame along the curve. For uniformity, name your M-File SpaceCurveFT, and 
let it start out: 

function x = Space CurveFT(k,tau,L) 

Note that a problem analagous to the one mentioned in Project # 6 will appear again 
hear. To get the Frenet frame along the curve you will solve the Frenet equations, and for 
this you can use the Runge-Kutta algorithm that you developed earlier. Then, to obtain 
the curve x you will need to integrate its tangent vector, i.e., the first element of the Frenet 
frame that you just derived, and since the tangent vector is not in the form of a Matlab 
function, you will need to use the version of Simpson's Rule developed for Project # 6 
where the input is a matrix that contains the values of the integrand at the nodes. 
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> Project 8. Fundamental Theorem of Surfacess 



This final Matlab project asks you to implement the Fundamental Theorem of Surface 
Theory as a Matlab function. It is a complicated problem and to manage the complexity 
successfully you will have to organize your work carefully and work slowly and deliberately. 
When you have completed this project, I think you will have adequate excuse to feel proud 
of both your programming skill and your comprehension of the mathematics involved. 



Review of Notation and Definitions 

Before stating the project we need to recall some definitions and notational conventions 
that will be used. O will be the rectangle [al,61] x [a2,62] in R^. A point in O will be 
denoted by p or (ti,t2) in a mathematical context or (tl,t2) in a Matlab context. We 
have two 2x2 symmetric matrix- valued functions, g and £ defined in O: g = (gij) and 
£ — {£ij). The matrix g should be positive definite, so in particular it is invertible and we 
denote its inverse by g~^ = {g^-')- By Cramer's Rule: 



-1 ^ 1 f 922 -gi2\ 
detig) \-gi2 gii ) ' 

i-e., g^^ = 5f22/det(5f), g'^'^ = gn/ det{g), and g^"^ = g"^^ = -5fi2/ det(5f), where det(5f) is 
the determinant of g, given by det{g) := (711(722 — gi2- We also have corresponding positive 
definite 3x3 symmetric matrices G and G~^ defined in O by: 



G 



and hence 



gii 


^12 





gi2 


g22 











1 







g'' 









g'' 







I 





1 



We also have two 3x3 matrix-valued functions and A"^ defined in O by: 




(\{gii)t2 {gi2)t2 - \{g22)H -42 \ 

A^= |(^22)ti i(^22)t, -^22 

V £12 £22 / 

and finally, there are two further 3x3 matrix- valued functions in (9, :— G~^A^. 
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The Gauss-Codazzi Equations 

If gij and £ij are the coefficients of the First and Second Fundamental Forms of a surface 
!F : O ^ Ti^, then the matrix- valued functions and defined in O as above satisfy 
the matrix identity 

P/^ - p2 ^ plp2 _ p2pl 

called the Gauss-Codazzi Equations. 
Statement of the Project 

The primary Matlab M-File should be called SurfaceFT.m and should start out: 
function F = SurfaceFT(gll,gl2,g22,lll,112,122,al,bl,a2,b2,TlRes,T2Res) 
where / := gij (tl ,t2) dti dtj and // lij (tl ,t2) dti dtj are quadratic 

forms in O, and the function F : O — > returned is supposed to be the surface having / 
and // as its First and Second Fundamental Forms. For this surface to exist, we know from 
the Fundamental Theorem that it is necessary and sufficient that / be positive definite and 
that the Gauss-Codazzi equations be satisfied. 

Of course the heavy lifting of the SurfaceFT will be done by AlgorithmF (i.e., the solution 
of the Frobenius Problem) which you will apply to integrate the frame equations in order 
to get the frame field f — after which you must apply AlgorithmF a second time to get the 
surface from fi and f2- 

But to carry out the first application of AlgorithmF, you must first compute the matrices 
P^ = G~^A^ and P^ = G~^A^ that define the right hand sides of the two frame equations. 
Recall that is the inverse of the 3x3 matrix 



and so it can be easily computed from the gij (tl ,t2) by using Cramer's Rule, while the 
two 3x3 matrices and A^ are given explicitly (see above) in terms of the gll (tl , t2) 
and their partial derivatives with respect to the ti . (Of course, once you have both 
G~^ and A^, you get as their matrix product.) 

In order to be able to compute the A'^, you will first need to define some auxilliary functions. 
Most of them can probably be subfunctions defined in the same file, though some could 
be separate M-Files. For example you will want to have a function called g(tl,t2) that 



functions G(tl,t2) and invG(t2,t2) that return the 3x3 matrices G and G . 

There is another complication before you can define the Matlab functions Al and A2 that 
represent A^ and A^. You not only need the functions gij(tl,t2) but also their first 
partial derivatives with respect to the variables tl and t2. I recommend that along with 
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the function g(tl,t2) you also define two more functions g_tl(tl,t2) and g_t2(tl,t2) 

that return 2x2 matrices whose entries are the partial derivatives of the gij (tl ,t2) with 
respect to tl and t2 respectively. As usual you can compute these partial derivatives using 
symmetric differencing — you don't need to do it symbolically. 

You should define a Matlab function GaussCodazziCheck that will check whether or not 
the Gauss-Codazzi Equations are satisfied. Once you have defined the two 3x3 matrix- 
valued functions and P^, it will be easy to write GaussCodazziCheck, since the Gauss- 
Codazzi equations are just P/^ ~ = P^P^ — P^P^. The idea is to check the identities 
numerically, matrix element by matrix element, at a sufficiently dense set of points, again 
using symmetric differencing to compute the derivatives. 

Of course, when you are all done you will need some good test cases on which to try out 
you algorithm. We will discuss this elsewhere. 

GOOD LUCK, AND HAVE FUN! 
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First Assignment 

Problem 1. When I want to see an initial explanation of something, I have for some 
time now used Google to do a search and then I read a few of the top-rated items that look 
promising. What I have found surprising is that this seems to be quite successful even for 
fairly abstract mathematical subjects. 

In the second lecture I plan to explain something called Felix Klein's Erlanger program. 
Use Google to try to get some idea what this is about, and after I talk about it in class, 
tell me if you think reading about it in advance this way helped you or not. 

You should do the next few exercises before the third lecture. They are designed for me 
to get some feedback from you on whether you find it easy to learn a topic by carrying 
out a short series of exercises. Please try to work through the following definitions and 
exercises and we will discuss in class whether you feel this is a good method for you to 
learn something. 

We start with a definition. 

Definition Let X be a set. A real- valued function p on X x X is called a metric or 
distance function for X if it satisfies the following three properties: 

a) Symmetry: p{x, y) = p{y, x) for all x and y in X. 

b) Positivity: p{x, y) > 0, with equality if and only if x = y. 

c) Triangle inequality p{x, z) < p{x, y) + p{y, z) for all x, y, z in X. 

By a metric space we mean a set X together with some fixed metric for X . (We will usually 
denote this metric by p^ , but if in a certain context there is no danger of confusion, we 
will often use just p.) 

Example 1. Take X to be R, the real numbers, and define y) = \x — y\. 

Example 2. More generally, take X to be R", and define p{x, y) — \\x — y\\. 

Example 3. Take X to be the sphere S^, and define p{x,y) to be the length of the 
shorter of the segments of great circles joining x to y. 

> Problem 2. Suppose {pn} is a sequence in the metric space X and p E X. Give a 

definition for what it means for the sequence {pn} to converge to p. (Hint: A seqence 
{xn} of real numbers converges to a real number x if and only if lim^^oo \xn — x\ = 0.) 
We usually write either pn p ot Um^^oo Pn — P denote that {pn} converges to p. 
Show that if — > p and Pn ^ Q then p — q, i.e., limits of sequences are unique. (Hint 
piPiQ) < PiPn,p) + p{Pn,q)-) 

Now suppose that X and Y are two metric spaces and that / : X — > y is a function 
mapping X into Y. We say that / is a continuous function if whenever a sequence {xn} 
in X converges to some limit a; in X, it follows that the sequence {f{xn)} in Y converges 

to f{x). 

Definition Let X and Y be metric spaces and f : X ^ Y a function from X into Y. If 
X is a positive real number, we say that / satisfies a Lipschitz condition with constant K 
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if PY{f{xi),f{x2)) < Kp^{xi,X2) for all xi and X2 in X, and we say that / is a Lipschitz 
function if it satisfies a Lipschitz condition with some constant K. 

> Problem 3. Show that every Lipschitz function is continuous. 

Definition A contraction mapping of a metric space X is a function that maps X into 
itself and that satisfies a Lipschitz condition with constant K < 1. 

> Problem 4. Let X be a metric space and f : X ^ X a, contraction mapping with 
Lipschitz constant K < 1. Prove the "Fundamental Inequality for Contraction Mappings": 



holds for all x,y in X. (Hint: This is VERY easy if you apply the triangle inequality in 
the right way. But where does K < 1 come in?) 



1 



{p{x,f{x)) + p{yj{y))) 



1-K 
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Second Assignment Due Friday, Sept. 12, 2003 

Some exercises on linear transformations and matrices. 

> Problem 1. Let vi, . . . ,Vn be a basis for a vector space V and let S and T be two 
linear operators on V. If the matrices of S and T relative to this basis are respectively 
Sij and Tij, then show that the matrix elements of the composed linear operator ST are 
given by {ST)ij = SikT^j, and that the matrix elements of the sum operator S + T 
are given by {S + T)ij = Sij + Tij. 

In what follows, denotes the space of polynomials functions ao + aix + a2x'^ + . . .+anX^ 
of degree < n. Clearly is a vector space of dimension n + 1 and 1 
basis for (called the standard basis). 

> Problem 2. Differentiation defines an operator D on P", and of course denotes 
the k-i\v derivative operator. 

a) What is the matrix of D in the standard basis? 

b) What is the kernel of D^l 

c) What is the image of D^l 

> Problem 3. Define an inner-product on by (Pi, P2) — J^^ Pi{x)P2{x) dx, and note 
that the standard basis is not orthonormal (or even orthogonal). Let us define orthonormal 

polynomials Lk{x) by applying the Gram-Schmidt Algorithm to the standard basis. (The 
Lk are usually called the normalized Legendre Polynomials.) Compute Lq,Li, and L2. 
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Third Assignment 



Due Friday, Sept.26, 2003 



Here are a few exercises concerning adjoints of linear maps. We recall that if V and W are 
inner-product spaces and T : V ^ W is a linear map then there is a uniquely determined 
map T* : W ^ V , called the adjoint of T, satisfying {Tv,w) = {v,T*w) for all v e and 
w eW. 

> Problem 1. Show that (T*)* = T. 

> Problem 2. Recall that if is an m x n matrix (i.e., m rows and n columns) and 
Sji axi n X m matrix, then Sji is called the transpose of Tjj if = Sji for 1 < z < m, 

1 ^ J < ^- Show that if we choose orthonormal bases for V and W, then the matrix of T* 
relative to these bases is the transpose of the matrix of T relative to the same bases. 

> Problem 3. Show that ker(T) and im(T*) are orthogonal complements in V, and 
similarly, im(T) and ker(T*) are each other's orthogonal complements in W. (Note that 
by Exercise 1, you only have to prove one of these.) 

> Problem 4. Show that a linear operator T on y is in the orthogonal group 0{V) if 
and only if TT* = I (where / denotes the identity map of V^) or equivalently, if and only 
if T* = T-i. 

If T : V — y is a linear operator on V, then T* is also a linear operator on V, so it makes 
sense to compare them and in particular ask if they are equal. 

Definition. A linear operator on an inner-product space V is called self-adjoint if T* = T, 
i.e., if {Tvi,V2) = {vi,Tv2) for aU vi,V2 G V. 

Note that by Exercise 3 above, self-adjoint operators are characterized by the fact that 
their matrices with respect to an orthonormal basis are symmetric. 

> Problem 5. Show that if is a linear subspace of the inner-product space V, then 
the orthogonal projection P of F on 1^ is a self-adjoint operator on V. 

Definition. If T is a linear operator on V, then a linear subspace t/ C is called a 
T-invariant subspace if T{U) C U, i.e., if tt e t/ implies Tu e U. 

Remark. Note that if t/ is a T-invariant subspace of V, then T can be regarded as a 
linear operator on U by restriction, and clearly if T is self-adjoint, so is its restriction. 

Problem 6. Show that if T : V — > F is a self-adjoint operator, and U C is a 
T-invariant subspace of V, the U-^ is also a T-invariant subspace of V. 

We next recall for convenience the definitions relating to eigenvalues and eigenvectors. We 
assume that T is a linear operator on V. 

If A is a real number, then we define the linear subspace E\{T) of V to be the set of 
V & V such that Tv = \v. In other words, if / denotes the identity map of V, then 
E\{T) = ker(T — XI). Of course the zero vector is always in E\{T) . If E\{T) contains 
a non-zero vector, then we say that A is an eigenvalue of T and that E\{T) is the A- 
eigenspace of T. A non-zero vector in Ex{T) is called an eigenvector of T belonging to the 
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eigenvector A. The set of all eigenvalues of T is called the spectrum of T (the name comes 
from quantum mechanics) and it is denoted by Spec(T). 

> Problem 7. Show that a linear operator T on F has a diagonal matrix in a particular 
basis for V if and only if each element of the basis is an eienvector of T, and that then 
Spec(T) consists of the diagonal elements of the matrix. 

> Problem 8. If T is a self-adjoint linear operator on an inner-product space V and 
Ai,A2 are distinct real numbers, show that E\^{T) and E\^{T) are orthogonal subspaces 
of V . In other words, eigenvectors of T that belong to different eigenvalues are orthogonal. 
(Hint: Let Vi G E\.{T),i — 1, 2. You must show that (fi,f2) = 0. Start with the fact that 

(T'i;i,'i;2) = {vi,Tv2).) 
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Fourth Assignment Due Tuesday, Oct. 6, 2003 



> Problem 1. Let X be a metric space. Recall that a subset of X is called open if 
whenever it contains a point x it also contains all points "sufficiently close" to and that 
a subset F of X is called closed if whenever a sequence in F converges to a point p oi X 
it follows that p E F. Show that a set is open if and only if its complement is closed. 

> Problem 2. Let X and Y be metric spaces, / : X — > y continuous, and A an open 
(resp. closed) subset of Y. Show that f~^{A) is open (resp. closed) in X. Deduce from 
this that the unit sphere, S{V), in an inner-product space F is a closed and hence compact 
subset of V. 

> Problem 3. Recall that a subset K of a metric space X is called compact if every se- 
quence in K has a subsequence that converges to some point of K (the Bolzano- Weierstrass 
property). Show that if / : X — > R is continuous real- valued function on X then / must 
be bounded on any compact subset K of X and in fact there is a point p of K where / 
assumes its maximum value. (Hint #1: If it were not bounded above on K, then there 
would be a sequence kn E K such that f{kn) > n. Hint #2: Choose a sequence kn & K 
so that f{kn) converges to the least upper bound of the values of / on K.) 

> Problem 4. Prove the so-called Chain Rule. 

Chain Rule. Let U, V, W be inner-product spaces, O an open set of U and O and open 
set of V. Suppose that G : Q ^ V is differentiable at u E il and that F : O ^ W 
is differentiable at p = G{aj) e O. Then F o G is differentiable at uj and D{F o G)^j = 
DFp o DG^. 

> Problem 5. Let / : R" ^ R"" be a function from R"" to R"^. We use the usual 
conventions, so that if a; = (xi, . . . , Xn) £ R"' then its image point f{x) has the m compo- 
nents (/i(xi, . . . , Xn)-, • • • , fm{xi, . . . , Xn))- Show that if / is differentiable at a point p of 
R" then the matrix of the differential, Dfp, with respect to the standard bases of R"^ and 
R"^, is just the so-called "Jacobian matrix" at p, namely the matrix of partial derivatives 

\> Problem 6. Let a : {a,b) ^ V and 7 : (a, 6) — > be differentiable curves in an inner- 
product space V. Show that ^ (cr(t),7(t)) = (cr'(t), 7(t)) + (a(t), 7'(t)), and in particular 
'Jt ~ 2 {a{t),a'{t)). Deduce that if a : {a,b) ^ V has its image in S{V), i.e., if 

||(T(t)|| is identically one, then a{t) and a'{t) are orthogonal for 11 1. 
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Midterm Exam Due Friday, October 24, 2003 
Part I: Successive Approximation 

If X is any set and f : X ^ X a, mapping of X to itself, then for each positive integer n we 
define a mapping ^ X ^ X by composing / with itself n times. That is, / \x) = f{x), 
f {x) — f{f{x)), f (x) — f{f{f{x))), etc. To be more formal, we define the sequence 
/ mductively by: / := / and / '■— J ° j 

> Problem 1. Show that /*^"^ o /^^"^ = 

> Problem 2. Let X be a metric space and suppose that / satisfies a Lipschitz condition 
with constant K. (Recall this means that p{f{xi),f{x2)) < Kp{xi,X2) for all xi,X2 £ X.) 
Show that / satisfies a Lipschitz condition with constant K". 

In what follows, we suppose that X is a metric space and that / : X — > X is a contraction 
mapping, i.e., we assume that / satisfies a Lipschitz condition with constant K < 1. (We 
refer to as a contraction constant for /.) We recall that in an earlier assignment you 
proved the so-called Fundamental Inequality For Contraction Mappings, namely, for all 
xi,X2 e X, 

pixi,X2) < yZTk (^^^^' •^'^^^^^ ^ •^'^^2)) • 

> Problem 3. Show that a contraction mapping / : X — X can have at most one fixed 
point, i.e., there is at most one point a; e X such that f{x) = x. 

> Problem 4. Show that if / : X — > X is a contraction mapping with contraction 
constant K and if x is any point of X then 

P{f {x),f [x)) < I ^ _^ \p{x,f{x)), 

and deduce that f'^ {x) is a Cauchy sequence. 

> Problem 5. Now prove: 

Banach Contraction Principle. If X is a complete metric space and / : X — X is a 
contraction mapping, then f has a unique fixed point p and if x is any point of X then 
the sequence {/^"' (x)} converges to p. 

Important Caveat! In applications, X is frequently a closed subset of a Banach space 
V (hence complete) and / is some mapping from X into V for which one can prove that 
/ satisfies a Lipschitz condition with constant K < 1. But that is not enough! One 
must also prove that / maps X into itself in order to apply the Contraction Principle. 

> Problem 6. Show that if / : X — > X is a contraction mapping and p is the unique 
fixed point of /, then for any x in X, p{f^'^\x),p) < [y^] p{.^if{^)) 
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Remark. The sequence {/ (x)} is usually referred to as the sequence of iterates of x 
under /, and the process of locating the fixed point p of a contraction mapping / by 
taking the limit of a sequence of iterates of / goes by the name "the method of successive 
approximations" . To make this into a rigorous algorithm, we must have a "stopping 
rule". That is, since we cannot keep iterating / forever, we must know when to stop. 
One rather rough approach is to keep on iterating until successive iterates are "close 
enough", but a better method is provided by the previous problem. Suppose we decide 
to be satisfied with the approximation / (x) if we can be sure that p{f {x),p) < e 
where e is some "tolerance" given in advance. We first compute /(x), then and 

then solve (^jzk^ p(^^ /(^)) = e for n and iterate n — 1 more times to get our acceptable 
approximation f^ ' {x) to p. 

> Problem 7. Solve i^^) p{^i /(^)) = e for n in terms of e, K, and p{x, f{x)). 

> Problem 8. Carry out the following (third) Matlab Project. (Make a printout of your 
version of the M-File and submit it with the exam, but also send an electronic version to 
Izi and me as an email attachment.) 

Third Matlab Project. 

Write an Matlab M-file that implements the Successive Approximations algorithm. Name it 
SuccessiveApprox.m, and use it to define a Matlab function SuccessiveApprox(/, K, x, eps). 
Assume that / : R"^ is known to be a contraction mapping with contraction constant 

K, that X e R", and you want to compute iterates of x until you are within eps of the 
fixed point p of /. Use a subfunction to compute the number of times n you need to iterate 
/ starting from x to get within eps of p, and then use a loop and feval to iterate applying 
/ to X the appropriate number of times. 

Part II: Inverse Function Theorems 

I don't think you will need any convincing that "solving equations" is an essential math- 
ematical activity. For us, solving an equation will mean that we have normed spaces V and 
W, a map / from a subset X of V into W, and given y ^ W we would like to find (some 
or all) X & X such that f{x) = y. In practice, what frequently happens is that we start 
with an xq and yo satisfying f{xo) — yo, and given y close to yo we would like to find the 
X close to Xq that satisfy f{x) — y. A so-called "inverse function theorem" is a theorem to 
the effect that, under certain assumptions on /, for each y in some neighborhood U of j/O; 
there is a unique x — g{y) near xq that solves f{x) = y. In this case g is called the local 
inverse for / near xq. Perhaps the mother of all inverse function theorems is the Lipschitz 
Inverse Function Theorem, which we state below after reviewing some standard notation. 

Notation. In the following, / denotes the identity mapping of the space V, so Fq — I — f 
means the mapping Fo{x) = x — f (x) and more generally for any y in V, Fy :— I — f + y 
means the map Fy{x) := x — f{x) + y. Also we denote the closed ball of radius e in F 
centered at vq by B^{vo, V) := {v eV \ \\v — vo\\ < e}. 

Lipschitz Inverse Function Theorem. Let V be a Banach space and f : O ^ V a 
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map of a neighborhood of the origin into V such that /(O) = 0, and suppose also that 
Fq := I — f satisfies a Lipschitz condition with Lipschitz constant K < 1. Then: 

1) f satisfies a Lipschitz condition with constant 1 + K. 

2) For r > small enough that, -Br(0, V) C O, the map Fy := I — f + y is a contraction 
mapping of Br{0, V), provided y in -B(i_x)r(0, V). 

3) For each y in B(^i_j^y{0, V), there is a unique x = g{y) in -Br(0, V) such that f{x) = y. 

4) This inverse map g : B(^i_xy{0,V) —>■ V satisfies a Lipschitz condition with Lipschitz 

constant jzrj^- 

Some general hints for the following problems, The next problems will lead you 
through the proof of the Lipschitz Inverse Function Theorem, and the following hints may 
be of some help. But first try to do the problems without looking at the hints. (You quite 
possibly will think of some or all of them on your own anyway.) 

a) Note that (since the "y"s cancel) Fy{vi) — Fy{v2) = Fo{vi) — Fo(f2), so any Lipschitz 
condition satisfied by one of the Fy is also satisfied by all the others. 

b) If you write out what it means to say that Fq satisfies a Lipschitz condition with constant 
K (and rearrange terms a bit) you will find ||(/(fi) — f{v2) — {vi — f2)|| < K \\vi — f2||- 

c) What does it mean for a; to be a fixed point of Fy? 

d) You are probably used to thinking of the triangle inequality in the form ||x + ?/|| < 
||x|| + ||y||, but if you replace xhj x — y you end up with ||x|| < \\x — y\\ + \\y\\, and quite 
often it is this second form of the triangle inequality that is easier to apply. 

> Problem 9. Prove conclusion 1) of the Lipschitz Inverse Function Theorem. 

> Problem 10. Prove conclusion 2) of the Lipschitz Inverse Function Theorem. (Hint: 
The only slightly tricky part is showing that Fy maps Br{0,V) to itself provided \\y\\ < 
(1 — K)r, i.e., that for such y, if ||a;|| < r, then also ||Fy(a;)|| < r. See the "Important 
Caveat!" immediately after the statement of the Banch Contraction Principle.) 

> Problem 11. Prove conclusion 3) of the Lipschitz Inverse Function Theorem. (Hint: 
You may want to look at general hint c) for this.) 

> Problem 12. Prove conclusion 4) of the Lipschitz Inverse Function Theorem. 

Remark. The principle application of the Lipschitz Inverse Function Theorem is as a 
lemma to prove the (far more important) Differentiable Inverse Function Theorem. We 
consider this next. 

More Notation. If V and W arc normcd spaces, then we denote by L{V, W) the space 
of all continuous linear maps T : V ^ W. (If V and W finite dimensional, then every 
linear map T : V ^ W is automatically continuous, so this is consistent with our earlier 
use of L{V,W).) We saw that there was a natural choice of norm for L(V, VF), namely 
|||T||| := supy^ii^i ||Tf II, or equivalently, |||T||| := sup||^||_^o ^]^^r[p- We also saw that 
1 1 1 T 1 1 1 was the smallest Lipschitz constant for T. If O is open in V and F : O ^ W 
is differentiable at every point of O, then we have a map DF : O L{V, W) called the 
differential of F, namely p ^ DFp, and we say that F is (or continuously differentiable) 
in O if this mapping is continuous. We recall also that if O is convex and if ||| DFp \ \\ < K 
for all p G O then we showed that K was a Lipschitz constant for F. 
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> Problem 13. Assume that F : O ^ W is , po e O and -fC > 1 1 1 DFp^ \ \\. Show that 
there is a neighborhood U of po such that K is a Lipschitz constant for / restricted to U. 

DiflPerentiable Inverse Function Theorem (1st Case). Let V be a Banach space 
and / : O — > F a map of a neighborhood of the origin into V such that /(O) = and 

D/o = /, the identity map ofV. If e > is sufEcicntly small, then there is an r > and a 
unique "inverse" map g : -Br(0, V) -Be(0, V) such that f{g{v)) — v for all v in Bf.{0, V). 
Moreover g is differentiable at the origin and Dgo — I. 

> Problem 14. Prove the 1st case of the Differentiable Inverse Function Theorem. 
Hint: First show that if e is sufficiently small then / — / satisfies a Lipschitz condition with 
constant | in B^{0, V) and apply the Lipschitz Inverse Function Theorem. 

Remark. The only hard part of this problem is showing that Dgo — I. But don't worry 
if you cannot prove that — it's an "extra credit" problem. 

Differentiable Inverse Function Theorem (2nd Case). Let Vand W be Banach 
spaces and F : O W a map of a neighborhood of the origin of V into W such that 
/(O) =0 and DFq has a continuous linear inverse. If e > is sufficiently small, then there 
is an r > and a unique "inverse" map G : Br{0, W) -Be(0, V) such that F{G{w)) = w 
for all w in Br{0, W). Moreover G is differentiable at the origin ofW and DGq = {DFo)~^. 

> Problem 15. Prove the 2nd case of the Differentiable Inverse Function Theorem. 
Hint: Prove this by reducing it to the 1st case of the Differentiable Inverse Function 
Theorem. Namely, define f : O ^ V by f := (DFq)-'^ o F, and carry on from there. 

And finally, the following general case of the Differentiable Inverse Function Theorem 
follows from the "2nd Case" simply by replacing F{v) by F{v + vq) — F{vo) ! 

DiflPerentiable Inverse Function Theorem. Let Vand W be Banach spaces, vq G V, 

and F : O ^ W a map of a neighborhood of vq in V into W such that DFy^ has 
a continuous linear inverse. If e > is sufficiently small, then there is an r > and a 
unique "inverse" map G : Br{F{vo), W) — > B^{xo, V) such that F{G{w)) = w for all w in 
Se(0, W). Moreover G is also C^, and in fact, if v = G{w) then DG^ = {DFyy^. 
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> Problem 1. Show that if a(t) = {x{t),y{t)) is a plane parameterized curve (not 
necessarily parameterized by arclength) then its curvature at a{t) is given by the formula: 

x'{t)y"{t)-y'{t)x"{t) 

Consider the semicircle of radius r as the graph y — \/r^ — x^, i.e., parameterized by 
x{t) — t, y{t) — \Jr'^ — with —r<t<r. Use the above formula to show that its 
curvature is -. 

r 

> Problem 2. Show that if the torsion function r of a space curve is identically zero 
then the curve lies in a plane. 

> Problem 3. Compute the curvature and torsion of the Helix: 

a{f) := (r cos(t), r sin(t), 5t) 



> Problem 4. Show that the "triple vector product" (tt x v) x is given by the formula 

{u^ v) ^ w — {u- w)v — {v ■ w)u. 

Definition Let F be a real vector space. A real-valued function B -.V xV ^His called 
a bilinear form on V if it is linear in each variable separately (i.e., when the other variable 
is held fixed). The bilinear form B is called symmetric ( respectively skew-symmetric) if 
B{vi,V2) = B{v2,vi) (respectively B{vi,V2) = —B{v2,vi)) for all vi,V2 G V. 

> Problem 5. Show that every bilinear form on a vector space can be decomposed 
uniquely into the sum of a symmetric and a skew-symmetric bilinear form. 

Definition A real-valued function Q on a vector space V is called a quadratic form if it 
can be written in the form Q{v) — B{v, v) for some symmetric bilinear form B on V. (We 
say that Q is determined by B. ) 

> Problem 6. (Polarization Again.) Show that if Q is a quadratic form on V then the 
bilinear form B on V such that Q{v) = B{v,v) is uniquely determined by the identity 
B{VI,V2) = l{Q{vi+V2)-Q{vi)-Q{v2)). 

Remark. Suppose that V is an inner-product space. Then the inner product is of course 
a bilinear form on V and the quadratic form it determines is just Q{v) = \\v\\ . More 
generally, A : V ^ V is any linear operator on then B^{vijV2) = {AvijV2) is a 
bilinear form on V and B^ is symmetric (respectively, skew-symmetric) if and only if A is 
self-adjoint (respectively, skew- adjoint). 
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> Problem 7. Show that any bilinear form on a finite dimensional inner-product space 
is of the form for a unique choice of linear operator A on V. (Hint. Recall the 
isomorphism of V with its dual space V* given by the inner-product.) 
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Final Exam Due Friday, December 5, 2003 



> Problem 1. Recall that if / : (9 R is a real-valued function we get a parametric 
surface T : O ^ R^, called the graph of /, by T{t\^t'2) := {ti,t2T f{ti,t2)). 

Show that the First Fundamental Form coefficients are: 

fifii = 1 + fti , gi2 = ftt ft2 , 922 = 1 + , 
and that the Second Fundamental Form coefficients are: 

// ftiti ij f tit2 I) fti.t-2 

•til = — ; -(-12 = — / •t22 = 



> Problem 2. Let t i— > Q;(t) = (a;(s),2(s)) be a curve parametrized by arclength lying 
in the 2;-plane and not meeting the 2;-axis — i.e., x{s) > for all s in the domain (a, 6) of 
a, and let O = (0, 27r) x (a, 6). The surface of revolution defined by a is the parametrized 
surface T : O ^ R"^, defined by J^{ti,t2) := {x{t2) cos{ti),x{t2) sm{ti), z{t2)). Show that 
the First Fundamental Form coefficients are: 

gii = x{t2f, gi2 = 0, 5r22 = 1, 
and that the Second Fundamental Form coefficients are: 

ill = -X{t2)z'{t2), £12 = 0, £22 = X"{t2)z'{t2) - x' {t2) z" {t2) . 

Show also that the principle curvatures are 

Z'{t2) 



x"{t2)z'{t2) - x'{t2)z"{t2) and 



X{t2) 



(so the Gaussian curvature is K = - -"i^^Wi^^f-^i^^^'i^^Wi^^) = - ). 

> Problem 3. Let q : R^ — R be a function and define symmetric 2x2 matrix 
-valued functions g and £ on R^ by: 

gn = cos^(g), 5'i2 = 0, g22 = sin^(Q), 

and: 

^11 = --^22 = sin(g) cos(g), £12 = 0. 

a) Derive explicit expressions in terms of q for the 3x3 matrices P^, P^, and also for their 
commutator [P^,P^] := P^P^ - P'^P^ . 

b) Prove that the Gauss-Codazzi equation 
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is satisfied if and only if q satisfies the so-called sine-Gordon equation (SGE) 

Qtiti - qt2t2 = sing cos g. 

(Hint: Check the the Gauss-Codazzi equation entry by entry. This gives 9 equations, 
most of which are automatically satisfied just because gi2 and £12 vanish, and the rest 
reduce to SGE. 

c) Now we know that if q satisfies the SGE, then, by the Fundamental Theorem of Sur- 
faces, there exists a surface in R^, unique up to rigid motion with First and Second 
Fundamental Forms respectively: 

0000 /00\ 

COS q dti + sin q dt2-, and sing cos g {dti — dt2). 

Use the formula K = to prove that the Gaussian curvature of this surface has 

the constant value —1. 



Note that if we find solutions g of the SGE, then gij^iij given in Problem 3 satisfy the 
Gauss-Codazzi equation, so your program can draw the corresponding K = —1 surfaces. 
The next two Exercises give two family of examples of solutions of the SGE. 

> Problem 4. Let a be a non-zero constant, and 

5(^1,^2) = 2 arctan C{ti,t2), 

where 

C(ti,t2) = exp (^^{a + a-^)ti + ^{a - a-^)t2^ . 

(i) Prove that cosg = and sing = ^^2- (Hint: by definition of g, tan | = C). 

(ii) Prove that g satisfies the SGE. 

(iii) Use your program to prove that for the case when a = 0.2, 0.4, 0.6, 0.8 and 1 

gii = cos g = I 1 , t/22 = sm g = I j^p^ 1 , ^12 = 0, 

and 

2C(1 — C^) 

4i = --^22 = sing cosg = , ^2 = 

(1 -I- c-^y 

satisfy the Gauss-Codazzi equation, and draw the corresponding surfaces. (Note that all 
these surfaces are of curvature —1, and when a = 1 you should get the pseudosphere and 
for a 7^ 1 you get a family of Dini surfaces) , 



108 



Math 32a Fall 2003 



R. Palais 



> Problem 5. Let < a < 1, and let 



Vl - a2 sin(a t2 

^[ti, 12) — 



and 



q;cos1i(\/1 — CK^ ^i) ' 
q{ti,t2) = 2arctanS(ti,t2), 

ffll =cos 9 = L ^^2 ) ' ff22 =sin g = L ^^2 ) ' ^i2 = 0> 

25(1 

4i = -■^22 = smgcosg = ^-^ _^ ^2)2 ' -^12 = 0. 
By direct calculation you can check that, 

2S(1 

gtiti - gt2t2 = (1 + ^2)2 = smgcosg, 

i.e., q satisfies the SGE. So gij and £y should give a surface with K = — 1 for each constant 
< a < 1, and in this exercise, we ask you to use your program to check the Gauss-Codazzi 
equation numerically and then draw the corresponding surfaces: Use your program to check 
that the above gij,iij satisfy the Gauss-Codazzi equation when the constant a = 0.4,0.6 
and 0.8, and draw the corresponding surface. (Note that B{ti,t2) is periodic in ^2, so to get 
beautiful picture you should draw your surface with domain t2 G [0, ^] and ti e [—2,2]. 
Also you can do some experiments to see what happen if you change a to other rational 
numbers between and 1). 
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y. Math 32a Fall 2003 Richard Palais Brandeis Univ. 

y. 

% First Steps An Introduction to Matlab Programming. 

"k In the following I assume that you already know how 
"k to start up Matlab and that you know how to add 
"L directories (= folders) to the Matlab search path. 
% The idea is to get a feeling for the Matlab syntax, 
% and a feeling for how to create certain data 
% structures and manipulate them. What I suggest is that 
% you go through the topics one by one, first reading the 
% notes, and then entering the commands in the Matlab 
% Command Window and make sure you understand why you 
% get the responses that you do. 

y. HELP and TUTORIALS 

help "k gives topics and functions for which help is available 
help <topic> e.g., help plot 
helpwin "k opens a help browser window 

helpdesk % A hypertext browser for Matlab documentation 
lookfor <topic> e.g. lookfor cos 

% which <f unction-name> % gives full path to function M-File . 
demo % stsrts a Matlab demo 

y, CALCULATOR 

2 + 2 
2 + 2; 

ans*ans 
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a=2; 
b=3; 
c=a+b 

y, COMPLEX NUMBERS 

a = 1 + 2i 

b = 3 - li 

c = a + b 

y, VECTORS AND THE COLON AND LINSPACE NOTATION 

a= [1 1 2 3.5 pi] 
b = 1:5 
c = a + b 

1:0.1:2 % Creates a row vector with entries 1 1.1 1.2... 1.9 2 
y, ANOTHER WAY IS linspace (FIRST, LAST, NUMBER) 

linspace (1 ,2, 10) 7, Gives a row vector with 10 equi-spaces elements from 
1 to 2. 

y. WHOOPS! 

linspace (1 ,2, 11) % Gives a row vector with 11 equi-spaces elements from 
1 to 2. 

y. MATRICES 

% Explicit manual entering. [abc...;def...; ...] 
% OR [a,b,c. . . ;d,e,f . ..;...] 

"k each element entered should either be a constant or an initialized variable. 
% entering a semi-colon starts a new row. 

"k elements in each row can be separated either by spaces or commas. 
A = [1 2 3 4; 5 6 7 8; 9 10 11 12] 

size (A) % returns (r,c) where r is # of rows of A and c = # of columns 
size (A, 1) % returns r 
size (A, 2) % returns c 
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% BRANCHING 



% if <condition> <statement> , <statement> , 
% or (better formatting) 
% if <condition> 



end 



<statement> 



<statement> 



% end 



% Notice that if you enter several Matlab commands on a single line, 
% then they should be separated by either commas or (to supress output) 
% semi-colons . 



% the following defines the signum of x, i.e., +1, 0, or -1 depending on 
whether 

% X is positive, zero, or negative, 
if (x > 0) 

sgnum = 1 

elseif (x == 0) 'L NOTE! == tests for equality. A single = is assignment. 

signum = 
else 

signum = -1 

end 

y, ITERATION USING FOR LOOPS 
for i = 1:5 i*i, end 



if (j ~= 0) 
k = 1/j 



end 



sum 



= 0; 
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for i = 1:5 sum = sum + i*i, end 
I 

sum = 0; 

for i = 1:5 sum = sum + i*i; end 

sum 

% 

t=0; 

t=cos(t) 

% The UP-ARROW KEY takes you back to the preceding command 

% This would make it easy here to execute t = cos(t) many times. 

% But even more convenient here is to use a "for loop" 

t = 0; 

for i = 1:5, t = cos(t), end 

% Better still make this more general as follows : 
t = 0; 
N = 5; 

for i = 1:N t = cos(t); end, t 

% For more convenience still we could make this into a Script 
"h Create a file named IterateCosScript .m (in your Matlab path) 
"/o with the following lines, 
t = 0; 
for i = 1:N 
t = cos(t) ; 

end 

t 

y. Then 

N = 8; 

IterateCosScript 

% The next step is to make a function M-File of this! 
% Create a file named IterateCos.m 
function IterateCos (N) 
t=0; 



114 



Math 32a Fall 2003 



R. Palais 



for i = 1:N 

t = cos(t) ; 
end; 
t 
% 

/o Now call IterateCos(5) , IterateCos (10) , 

"/o use format long to see more precision 

format long 

IterateCos (30) 

IterateCos (60) 

IterateCos (80) 

IterateCos (100) 

% Matlab keeps track of all the variables that you have 
% defined in the current session and their current values. 
% The command 
% whos 

% gives list of variables in the workspace . 
whos 

"/o clear clears the current workspace 

clear 

whos 

y. MORE COLON NOTATION 
horizontal= [1 : 6] 
horizontal= [horizontal , 7, 8] 
horizontal = (l/8)*horizontal 
horizontal = horizontal (2: 7) 
vertical = horizontal' 

y, THE PLOT COMMAND 

% We will look carefully at the plot command later, 
% but here is how to plot a list of (x,y) values and 
y, join successive ones by straight lines. 
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N=10; 

X = (1/N)*2*pi* [0:N] ; y = sin(x) ; plot(x,y); 
N=20; 

X = (1/N)*2*pi* [0:N] ; y = siii(x) ; plot(x,y); 
N=20; 

X = (l/N)*2*pi*[0:N] ; 
plot(sin(x) ,cos(x)) ; 
% ??? why don't we get a circle? 
plot (sin(x) , cos (x)) ; axis equal; 
a=3; b= 2; 

% Math 32a Fall 2003 Richard Palais Brandeis Univ. 

% Second Steps More on Matlab Programming. 

I 

% Topics for Today 

y. 

"k 1) Subscripting or Indexing 
y, 2) Vectorizing code 
"k 3) Functions 

"L 4) Relational Operators and Boolean Expressions 

y, 5) Flow Control 

% a) if else 

% b) for loops 

% c) while loops 

% d) switch statement 

% 6) 2D and 3D Graphing: the plot, plot3, mesh, and surf commands 

y, 7) M-Files 

y. a) Script M-Files 

y, b) Function M-Files 
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0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o 

y, 

% To practice with Matlab on your own, choose 

% a topic and enter the lines, one by one, into 

"h the Matlab Command Window, and make sure you 

°h understand all the output you get back before 

% going on to the next topic. 

y. 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% Subscripting 

y. 

a = [0.0: 0.1: 1] 

ad) 

a(5) 

a (end) 

b = [0:5 ; 1:6; 2:7 ; 3:8 ; 4:9] 
b(2:4, 4) 
b(3, 2: end) 
b(4,4) = 



0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 

% Stopwatch Functions 

y, 

% If you execute the command tic, Matlab starts 
% a computation time stopwatch. The next time you 
% execute the command toe, Matlab reports how much 
% computing time in seconds it has used. 

U to U 10 19 to IQ to U 10 IQ 10 19 19 19 19 19 19 19 19 10 U 

% Vectorizing Code 

y. 

% A matlab command is said to be "vectorized" if it can act 



117 



Math 32a Fall 2003 



R. Palais 



% not only on scalars , but also on vectors and matrices 

% (Often this just means it does to each element of an array 

% what it would do to a scalar) . But as the next two examples 

% show that's not always the case. 

% 

Z Calcuate Factorial 150 two ways, with a loop and using vectorized product, 
tic, factorial = 1; for i = 2:150, factorial = i*factorial; end, toe 
tic, factorial = prod(l:150); toe 
t 

% A similar pair of computations for summing ein arithmetic progression, 
tic, SUM = 0; for i = 1:10000, SUM = i + SUM; end, toe 
tic, SUM = sum(l : 10000) ; toe 

% Notice that most built-in Matlab functions are vectorized. 

X = [1:10] 

sin(X) 

X'-2 

% Why the error message? 

% The problem here is that for a matrix, Matlab uses "2 to mean 
% matrix squaring, which only makes sense for sauare matrices. 

"L For example : 
X = [1,2;3,4] 

"L Vectorized squaring (i.e., squaring each element of an array 

Z is denoted by ."2. 

X."2 

% Similarly to multiply corresponding elements of two matrices 
% with the same number of rows and columns, use .* 
Y = [4,3;2,1] 
X.*Y 

% Similarly for vecorized division, use ./ 
X./Y 

% X/Y (without the dot) means matrix product of X with Y inverse. 
X/Y 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 



118 



Math 32a Fall 2003 



R. Palais 



% Inline Functions 

I 

% Suppose we want to create the polynomial function 
y, f(x) = 3*x'-2 + 5*x + 2 

% Create a string S that defines the polynomial and 
y„ assign inline (S) to the name of the function: 
f = inline ('3*x"2 + 5*x +2') 
f (1) 
f(2) 

V = [0:5] 
f(v) 

% We got an error because we didn't vectorize properly, 
f = inline('3*x.'"2 + 5*x + 2') 
X = [-3: 0.1 : 1.5] ; 
plot(x,f (x)) ; 

y. 

% Relational Operators and Boolean Expressions 

y. 

"L The basic relational operators are 

% > , <,>=,<= with the obvious meanings, and 

% == which means "equals" and ~= which means "not equal" 

% If R is any one of these operators and x and y are 

% constants or variables then xRy is a boolean 

% expession, i.e., it eiher has the value 1 meaning 

% xRy is true, or it has the value o meaning xRy is false. 

y, DON'T CONFUSE (A == B) with A = B ! ! The latter assigns the 

% value of B to A, while (A == B) does not change the value 

% of A and rather is an expression that has the value 1 if 

% A is equal to B and otherwise has the value zero. 

% You can build up more complex boolean expressions by 

% combining basic one with & (which means AND) and I (which 

y, means OR) and ~ (which as we have already seen means NOT) . 
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% First check that the relational operators are vectorized 

A = 0:8 

B = 8-A 

booll = A>4, 

bool2 = (A==B) 

bool3 = booll & bool2 

bool3 = booll I bool2 

1 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 

y. Flow Control 

y. 

% if , else , and elseif 

y. 

% The general form of an if statement is : 

y. 

% if booleanexpression 
% command 1 

% command 2 

y. 

% else 

y, COMMAND 1 

y, C0MMAND2 

y. 

% end 

y. 

% If booleanexpression evaluates to l(true) the first 

% group of commands is executed, otherwise the second 

% set of commands is executed. For example here is a 

% way to compute the maximum of a and b. To create a 

% multi-path branch with more conditions, replace all 

% but the final else by elseif. 



max = 0; 
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a = 5; 
b = 3; 
if (a>b) 

max = a; 
else 

max = b; 
end 
max 



0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o 

% for loops 

y. 

% We have already seen several exeimples . 

% However ther is more than meets the eye . 

% The genral form is: 

y. 

y, for X = Array 

y, command 1 

% command 2 

y. 

% end 

y. 

% First X is set equal to the first column of 

% Array and all the commands executed, then x is 

y, set equal to the second column of Array and 

% the commands executed again and so on until 

% the last column of Array is reached. 

y. 



% while loops 

y. 

y. Here the general form is: 

y. 
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% while booleanexpression 

% command 1 

% command 2 
% 

% end 
7. 

°/o First, booleanexpression is evaluated, and if 

% it evaluates to 1 (true) the commands are 

% executed, then booleanexpression is re-evaluated 

% and if it is true then the commands are evaluated 

% again, and so on until booleanexpression evaluates 

% to (false) at which point contol shifts to 

% the first command after the end statement. 

% Of course something better happen durring execution 

% of the commands that will eventually mcike 

% booleanexpression false or we wre in an infinite loop. 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/^ 

% switch statement 

y. 

"k The switch statement allows a program to switch 

"k its execution path to any one of a number of possible 

y, different branches depending on the value of an expression 

% (the switch-expression) . 

% It has the general form: 

y. 

% switch <switch-expression> 

% case <case-expression> statement .statement .statement , 

% case <case-expression> statement .statement .statement , 

y. ... 

% otherwise statement .statement. statement. 

% end 

y. 
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% First <case-expression> is evaluated. It should evaluate to 

% either a scalar or a string. Control then jumps to the 

% statements following the first case-expression that 

% matches the value of switch-expression, or if there is no 

% match to the statements following otherwise (or if there is 

"k no otherwise statement, to the statement following end. 

y. Example : 

y. 

CurveType = 'Cubic'; 
switch CurveType 
case 'Linear' 

f = inlineCa + b*x') ; 
case 'Parabola' 

f = inlineCa + b*x + c*x'"2'); 
case 'Cubic' 

f = inlineCa + b*x + c*x'"2 + d* x'"3'); 

end 
f 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% Graphing 
"k 2D curves 

% A circle centerd at (a,b) with radius r is given parametrically by 
% X = a + r*cos(t) y =b + r * sin(t) with t in [0, 2*pi] 
a = 1; 
b = 2; 
r = 2; 

t = [0: 0.1: 2*pi] ; 
X = a + r* cos(t) ; 
y = b + r* sin(t) ; 
plot(x,y); axis equal 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

In h It It It It It It It In h In In ID ID 

y. 3D Curves 

y. Helix X = cos(t); y = sin(t) ; z = 0.2*t; 
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t = [0: 0.1: 6*pi] ; 
X = cos(t) ; 
y = sin(t) ; 
z = 0.2*t; 
plots (x,y,z) ; 

rotate3d; "/oThis permits you to rotate the 3D object with the mouse. 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o 

% Parametric Surfaces 

y. 

% In studying so-called polar spherical coordinates, you 

% probably learned that the point on the unit sphere 

% with longitude u and co-latitude v has the (x,y,z) 

% coordinates x = cos(u), y = sin(v) , and z = cos(v), 

% Here is the way to render the sphere in Matlab. 

% First , this is the command to create a two-dimensional grid of 

% points (u,v) that will represent the longitude and co-latitude 

% of points of the sphere. Let's divide both intervals [0, 2*pi] 

% and [0,pi] into 50 sub-intervals : 

[u,v] = meshgrid([0 : 2*pi/50 : 2*pi] , [0 : pi/50 : pi]); 

"k Then we create the arrays of values of the components of the 

"L 3D points (x,y,z) that have longitude u and co-latitude v: 

X = cos(u) . *sin(v) ; 

y = sin(u) . *sin(v) ; 

z = cos(v) ; 

% Finally, the command mesh(x,y,z) takes the 3D grid that we have 
% created and maps it into 3-space using "wireframe rendering" . 
% This just means that each 2D gridlines is mapped to the 
% 3D segment joining the images of its endpoints. 
mesh(x,y,z), axis equal 

% On the other hand, surf(x,y,z) renders the grid in "patch mode". 
% This means that each rectangle of the grid is filled in with a 
% color that is determined by an algorithm we will discuss later. 
surf(x,y,z), axis equal 
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y. 

% Exercise: Render the ellipsoid with semi-major axes a,b, and c. 

hhUlfilfihUhUhlfilfilfilfilfilfiUUhlfihlfihU 

y. Script M-Files 

y. 

"L The first kind of M-File, called a Script File, is easy to 

'L explain. It is just a list of Matlab commands written 

"L just as you would write them into the Matlab command window. 

% When you tyoe the name of the Script File (without the .m) 

% into the commeind window, the effect is exactly the same as if 

% you typed all the commands in the script File, one after another, 

% into the command window at the place. End of story. 

% (Well, almost, you do have to make sure that the script file is in 

% a directorythat is in matlab 's search path in order for Matlab to 

% be able to f ind it . ) 

y. Function M-Files 

y. 

"k The second kind of M-file, called a function M-File is a lot more 

"L sophisticated and more flexible, and it is the real key to what it 

y, takes to write powerful Matlab programs. They are much like subroutines 

% in other programming languages that you may be familiar with. We will 

% probably have a lot more to say about them in the weeks to come. 

% For an example, let's use the above switch statement to create a 

% function file called PlotCurve.m that will plot a line, parabola, 

% or cubic, depending on a string parameter the user enters. 

function PlotCurve(CurveType) 

% This function plots either a line, a parabola or a cubic curve depending 
y, on whether it is called with peirameter 'Linear', 'Parabola', or 'Cubic'. 
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t = [-1.5: 0.05: 1.5] ; 
switch CurveType 
case 'Linear' 

plot(t, 1 + 2*t) ; axis equal 
case 'Parabola' 

plot(t, 1 - 0.5*t + 2*t."2); axis equal 
case 'Cubic' 

plotCt, 1 - 1.5*t + 2*t."2 + 2.5* t."3); axis equal 

end 
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y. Math 32a Fall 2003 Richard Palais Brandeis Univ. 
% Discussion of Project 1 

Z Here is how I would go about developing the solution 
"L to Project 1. I would not start with an M-File, but 
°/o first try to develop commands to implement the various 
y„ steps of the algorithm in a text file such as this, 
% and test them out in the mMatlab Command Window, and 
% then when the pieces of my code seemed to be working 
% properly, I would put them in a function M-file and 
% add error checking. (It might even pay to have an 
% intermediate step consisting of a script M-File, but 
% for a simple project such as Project 1, that is not 
% necessary. 

% Recall , the goal is to apply Gram-Schmidt algorithm to 
% the rows of a matrix M. 

"k Here again is a statement of the algorithm: 
"k 1) First normalize the initial row. 

% 2) Then, in order, project each row (the current_row) 
% onto the (already orthonormalized) earlier rows. 
% 3) Subtract this projection from the current row to 
% get the projection normal to earlier rows, and then 
% 4) normalize the result. 
% OK, here goes: 

% To normalize the initial row of M, namely M[l,:]. 

% Compute its norm 

norml = sqrt(M(l,:) * M(l,:)'); 

% We could also have written this as 

% norml = sqrt( dot(M(l,:) , M(l,:))); 
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% or as : 

y, norml = norm(M(l , : ) ) ; 

y, using Matlabs built-in functions dot and norm. 

'L Ignore possibility that norml might be zero for now 
"L and divide the first row by its norm 

M(l, :) = M(l, :)/norml; 

% This completes step 1) above. 

% Now start the loop that will orthonormalize later rows. 

% Recall that the number of rows of M is size(M,l) 

% so we want to iterate over the list of rows from 

% row number 2 to row number size(M,l). In matlab-speak this is: 

for row_num = 2:size(M,l) 

current _row = M(row_num, :) ; 
% project current_row of M onto each earlier row and add the projections 
% to get the projection of current_row on span of earlier rows 
proj = 0; 

for j = l:row_num - 1 
proj = proj + dot (current_row,M(j , : )) * M(j,:); 
end 

y. Now subtract proj from the current row to get the projection of the 
% current row orthogonal to earlier rows . 

u = current _row - proj ; 
norml = sqrt(u*u'); 
M(row_num,:) = u/norml; 
end; 

y, 
y, 

% Set up a test matrix. 

tst = [1 2 3 4;2 3 4 1;3 4 1 2; 4 1 2 3] 

y, set M equal to tst 

M = tst 
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% Then copy the above code and test it on M 

1 

1 

y, next we add the boilerplate necessary to make our early 

y, code into an M-File, and also add error checking. 

% 

y. First , here is the Help Comment : 

% The fiinction GramSchmidt takes as its single input 

y, argument and m by n matrix M of real numbers eind returns 

% an error message if the rows of M are linearly dependent, 

% but if they are independent then it returns a matrix 

% with orthonormal rows having the same size as M and such 

% that the first k rows of Q have the seime span as th first 

% k rows of M. 

y. Programmer: Richard S. Palais 

function X = GramSchmidt (M) 

norml = sqrt(M(l,:) * M(l,:)'); % norm of the first row; 
if (norml <0. 000000001) 

Q = 'First row is zero. Cannot continue.'; 
disp(Q) ; 
return 
else 

M(l, :) = M(l, :)/norml; 
end % if 

% Start loop to orthonormalize later rows . 
for row_num = 2:size(M,l) 

current _row = M(row_num, :) ; 
y, project current _row of M onto each earlier row and add the projections 
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% to get the projection of current _row on span of earlier rows 
proj = 0; 

for j = l:row_num - 1 

proj = proj + dot (current _row, M(j , :)) * M(j,:); 
end % for j = l:row_num - 1 
Now subtract proj from the current row to get the projection of the 
y, current row orthogonal to earlier rows. 

u = current _row - proj ; 
norml = sqrt(u*uO; 
if (norml <0. 000000001) 

Q = 'Rows are linearly dependent, cannot continue.'; 
disp(Q) ; 
return 
else 

M(row_num,:) = u/norml; 
end y.if (norml <0. 000000001) 
end; % for row_num = 2:size(M,l) 

X = M; 
y. END OF GramSchmidt 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% Here is a somewhat selection of a few more solutions developed by 
% various class members. 

y. First, David Diamondstone ' s version 

% Call as N = GramSchmidt (M) . 
% M should be a rectangular 
y, matrix with linearly independent rows, 



130 



Math 32a Fall 2003 



R. Palais 



% and then N will be a matrix of the same size with orthonormal rows 
% and the linear spans of the first k rows of M and N are the same. 

% Progrcimmer: David Diamondstone 

function N=GramSchmidt (M) 

r=size(M,l); c=size(M,2); 
for i=2:r, 

for j=l:i-l, 

M(i :r :r*c)=M(i :r :r*c)-(M(i :r :r*c)*M(j :r :r*c) ' )/(M(j :r :r*c)*M(j :r :r*c) ' )*M(j 
if M(i :r :r*c)*2==M(i :r :r*c) , 'The input matrix was not linearly independant . ' , 
Failure_Row=i , 
end; 

end; 
end; 

for i=l:r, 

M(i :r :r*c)=M(i :r :r*c)/sqrt (M(i :r :r*c)*M(i :r :r*c) ' ) ; 
end; 
N=M; 

"h Comments on David's M-File. 

"/o Note that David first orthogonalizes 

% all the rows, and only then normalizes them. 

% This has a number of advantages ! Can you see them? 

y. Pros : It is VERY short and succinct . 

% Cons: It is a little hard to understand. 

% The error handling is less than prfect, and 

% in particular, it fails to handle 

% the case that the firt row is zero. 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 
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% Here is Lacra Bintu's M-File: 

% GramSchmidt takes a matrix with linearly independent rows and returns another 
matrix 

% whose rows are orthonormal to each other. 

Zlf the rows of the input matrix are not linearly independent, the GramSchmidt 
will give 

% an error message. 
% Programmer: Lacramioara Bintu 
function F=GramSchmidt (M) 

n=size(M,l); m=size(M,2); "/omatrix dimensions 
if M(l, :)*M(1, :) '==0 

F='The rows of your matrix are not linearly independent! Orthonormalization 
is impossible ! ' ; 

else 

F(l, :)=M(1, :)/((M(l, :)*M(1, :) ')"(l/2)) ; "/.normalize the first row 

for i=2:n 

vi=0; 

for k=l:i-l 

vi=vi+(M(i, : )*F(k, : ) 0*F(k, : ) ; "/.project the k'th row onto the space of the 
first k-1 orthonormalized vectors 

end 

ui=M(i, : )-vi; "/subtract the projection from the original i'th row vector 

u=(ui*ui ' ) " (1/2) ; "/find the norm of the difference 

if (u<10'"(-10)*mean(mean(abs(M)))) 

% if the norm is zero give error message 

F='The rows of your matrix are not linearly independent! Orthonormalization 
is impossible ! ' ; 

break %stop going through the loop 

else 

F(i,:)=ui/u; "/normalize the difference obtained above 

end 

end 
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end 

% Comments on Lacra's M-File 

% Pros: Quite short, but well-commented and so reasonably easy to understand. 
°h Appears to work correctly for matrices with linearly independent rows, 

"h and error handling is good. 

"L The scaling in the line if (u<10" (-10) *mean(mean(abs (M) ) ) ) 

% is a very nice touch, since it correctly makes the test depend 

% on the relative round_off error rather than absolute round-off error. 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

"/oChandni Raj an Valiathan's M-File 

"/oThis function takes as input, a rectangular matrix M of size m x n whose 
Zrows are linearly independant. It transforms the matrix to one whose rows 
y.are orthonormal and whose first K rows spein the same subspace as that 
"/oSpanned by the first K rows of M. If it gets, as input, a matrix that has 
"/olinearly dependant rows, it gives an error and no matrix. You can call the 
yofunction as follows >> GramSchmidt (A) (where A is the matrix whose rows 
y.you want to be orthonormalized. ) 

^Programmer : Chandni Raj an 

yoVciliathan 
y,Math 32a Fall 2003 
yProject 1 

function F= GreimSchmidt (M) 

m= size (M, 1); Zno. of rows 

v= M(l,:); 

normv= sqrt (v*v ' ) ; 

if (normv == 0) yoif the first row is the zero vector, then the matrix is 
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"/olinearly dependant so display an error and return to the 

prompt 

F= 'Input matrix has linearly dependant rows, so impossible to orthonormalize' ; 
return ; 

else 

F(l,:)= (l/normv)*v; "/.otherwise normalize it and replace the first row 
of M with 

°/othe new orthonormalized vector. 

end; 

for i=2:m, 

w=0; "/.reset w which stores the orthogonal projection 
vi= M(i, :); %vi= ith row of vectors 
for j=l: (i-1), 

w= w + (vi*(F(j , :)) 0*F(j , :) ; 
end; yoorthogonal projection of v onto the subspace W of V 
u= vi - w; 

normu= sqrt(u*u'); yon=norm of u 
if (normu < le-5) 

F= ' Input matrix has linearly dependant rows , so impossible to orthonormaliz- 
return ; 

"/.vectors not linearly dependant so error displayed 

else 

F(i,:)= (1/normu)* u; 

end; 

end; 

% Comments: Clear and well-documented. Works correctly and has good error 
handling . 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

°/o Anny Jones M-File is very carefully commentes and 
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% GramSchmidt 

% This program takes as input a rectangular matrix (M) of arbitrary size m 
X n, 

% and assuming that m rows are linearly independent, transforms (M) into another 
% m X n matrix (Q) whose rows are orthonormal, vis-a-vis the Gram-Schmidt 
% Algorithm. The subspace spanned by the first k rows of (Q) is equal 
% to the subspace spanned by the first k rows of (M) . 

% Programmer: M. Anny Jones 

y. M = input ('matrix M = '); 
function GramSchmidt (M) 

% First I will determine the size of input matrix (M) : 
m = size(M,l); n = size(M,2); 

% I will duplicate matrix (M) and overlay each row as it is calculated 
Q = M; 

% Next, I will define Ql, the first element of output matrix (Q) : 
w = M( 1, l:n ) ; 

% Since we know that the norm of vector w is the square root of the inner 
product 

% <w,w>, which can be written w*w' when w is a row vector: 
normw = (w*wO"0.5; 
if normw == 

dispC'The first vector of (M) is zero. Please correct.') 
return 

end 

Q( 1, l:n ) = w./ normw ; 

% Here I have overlaid my first vector (Ql, if you will) over (M) 
% Once m rows have been replaced, matrix Q will be the solution. 
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% Now, using Ql, we can iterate the process to find the final elements Qi: 
for i = 2:m, 

w = M( i, l:n ); 

s = 0; 

for j = l:i-l, 

V = (w*Q( j, l:ii)0*Q( j, l:ii); 
s = s + v; 

end 

"h Here, s is the projection of Mi onto Wi-1, ie. the projection of the 

"h ith row of M onto the subspace spanned by the first (i-1) rows of M 
(or Q). 

y„ I have used a second 'for' to represent the summation over j = l to j=i-l 
u = w - s; 

if (u*u' < 0.000001) 

disp( 'Program cannot be completed! Please check that the') 
dispCrows of the entered matrix are linearly independent.') 
return 

else 

normu = (u*u')''0.5; 

Q( i, l:n ) = u. /normu; 

end 

end 

% Now I have found each subsequent row of Q and the result is displayed. 
Q 

y. Math 32a Fall 2003 Richard Palais Brandeis Univ. 
% Discussion of Project 2 

% Let's first write the code for the trapezoidal approximation 
% to the integral of a function f over [a,b] without subdivision. 

trapezoid = 0.5*(b-a)*(feval(f ,a) + feval(f,b)); 
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% We recall that a bound for the error is given by 

ErrT = Cl*(b-a)~3/12; 

% where CI is the maximum of the absolute value of f' on [a,b] . 

"/o Similarly, the Simpson's Rule approximation to the integral 
% of f over the same interval, without subdividing, is 

Simpson = ((b-a)/6)*(f eval(f ,a) + 4 * f eval(f , (a+b)/2) + feval(f,b)); 

% and in this case, a bound for the error is given by 

ErrS = C2*(b-a)-^5/90; 
% where CI is the meiximum of the absolute value of f''' on [a,b] . 
% Lets try this out on a simple function, say sin: 

f = 'sin' ; 

% on the interval [0,pi/2] 

a = 0; 
b = pi/2; 

% Since -cos is an antiderivative for sin, the exact value 
% of the integral is 

integral = (-cos (pi/2) - ( - cos(O))) 

y. Also, clearly CI and C2 = 1; 
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CI = 1; 
C2 = 1; 

% Now lets design the M-Files. 

% First TrapezoidalRulel .m 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 

fxinction Approxint = TrapezoidalRulel (f , a, b,ii) 

% This computes the approximation to the integral 

°/o of the function f from a to b by dividing the 

% interval into n equal parts and applying the 

% Trapezoidal Rule approximation to each part and 

% then summing. 

% Richard Palais 

h = (b-a)/n; 
Approxint = 0; 
for k = [0:ii-l] 

al = a + k*h; 

bl = al + h; 

Approxint = Approxint + trapezoid(f ,al ,bl) ; 
end; 

lllllll Auxiliary Function %%%%%%% 
function term = trapezoid (f , a, b) 

term = 0.5*(b-a)*(feval(f ,a) + feval(f,b)); 
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10 19 19 IQ IQ to 10 U 10 U 19 U 10 U to U to U IQ U U 



01 01 01 01 01 01 01 01 01 01 01 01 01 01 01 0/ OtOI 01 01 01 01 01 01 0/O/O/Ot 01 01 01 01^ 

to to to to to to to to to to to to to to to to to to to to to to to to to to to to I 



function Approxint = SimpsonsRulel (f , a,b,n) 

"/o This computes the approximation to the integral 

"lo of the function f from a to b by dividing the 

% interval into n equal parts and applying the 

% Simpson's Rule approximation to each part and 

"lo then summing. 

% Richard Palais 

h = (b-a)/n; 
Approxint = 0; 
for k = [0:n-l] 

al = a + k*h; 

bl = al + h; 

term = Simpson(f , al ,bl) ; 
Approxint = Approxint + term; 
end; 



term = ((b-a)/6)*(feval(f ,a) + 4 * f eval(f , (a+b)/2) + feval(f,b)); 



0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o« 



"lo The second versions below avoid he auxiliary 
"lo function calls, AND more importantly, they 



"lo Next 



SimpsonsRulel .m 



"i:i:i:i:i:i:io Auxiliary Function %%%%%%% 



function 



term = Simpson (f , a, b) 
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% avoid re-evaluating the integrand twice for 
°/o each interior endpoint of an interval 

% TrapezoidalRule2 .m 

function Approxint = TrapezoidalRule2(f ,a,b,n) 

% This computes the approximation to the integral 

% of the function f from a to b by dividing the 

% interval into n equal parts and applying the 

% Trapezoidal Rule approximation to each part and 

% then summing. 

% Richard Palais 

h = (b-a)/n; 

sum = (fevaKf ,a) + feval(f ,b))/2 ; 
X = a; 

for k = [l:n-l] 
X = X + h; 

sum = sum + feval(f,x); 

end; 

Approxint = h * sum; 

U 19 19 U U U U U U U U U 19 U U iQ U U iQ u 

% SimpsonsRule2 .m 

19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 19 U 19 19 U 

function Approxint = SimpsonsRule2(f ,a,b,n) 
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% This computes the approximation to the integral 

% of the function f from a to b by dividing the 

% interval into n equal parts and applying the 

% Simpson's Rule approximation to each part cind 

% then summing. It gains efficiency by grouping 

"k terms so that the function is not evaluated 

°/o more than once at the same argument . 

% Richard Palais 

h = (b-a)/n; 
X = a; 

z = a + h/2; 

sum = (feval(f,a) + feval(f,b)) + 4 * feval(f,z); 
for k = [l:n-l] 
X = X + h; 
z = z + h; 

sum = sum + 2 * feval(f,x) + 4 * feval(f,z); 

end; 

Approxint = (h/6) * sum; 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

y. The third versions below avoid the loop by 
% vectorizing the sum, and they also avoid 
% evaluating the integrand more than once for 
% a given value of the argument . The code is by 
% Nick Dufresne. (slightly modified). 

U to 10 U 10 19 to IQ to U to U to 19 U 10 to 10 IQ U 

°/o TrapezoidalRuleS .m 

to U to U to to to to to to to to to to to to to to to to to to to to to U 
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"/oiiick dufresne 

y, 

y.usage : 

% result = TrapezoidalRule3(f ,a,b,n) 

y. 



f is an inline function that maps a real input 


to 


a vector 


a is the starting point 






b is the ending point 






n is the number of sub-intervals into which [a 


,b] 


is divided 


result is the estimated value of the integral 







y. 

function thesum = TrapezoidalRule (f ,a,b,n) 
delta = (b-a)/n; 
arguments = [a: delta :b] ; 

y.calculate all the values of the function 

Zin summing all n parts of the trapezoidal method we count internal points 
y.twice so we will multiply by 2 

values = 2*feval (f , arguments) ; 

yosince we have calculated the value of the endpoints twice we need to 
^subtract the values and we need to multiply by 0.5*delta = l/2*(b-a)/n 

thesum = 0.5*delta*(sum(values)-feval(f ,a)-feval(f ,b)) ; 

IfilfilfilfilfilfihUhUhUhlfilfilfilfilfilfihUhU 

% SimpsonsRule3 .m 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

ynick dufresne 

y. 
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"/ousage : 

% result = SimpsonsRule3(f ,a,b,n) 

% 

% f is an inline function that maps a real input to a vector 
% a is the starting point 

b is the ending point 
% n is the number of sub-intervals into which [a,b] is divided 
% result is the estimated value of the integral 

y. 



function thesum = SimpsonsRule (f ,a,b,n) 
delta = (b-a)/n; 
arguments = [a: delta :b] ; 

midpointArgs = [a+delta/2 :delta:b-delta/2] ; 

Zcalculate all the values of the function. 

y„in summing all n parts of the trapezoidal method, 

y.we need to count internal pointstwice so we multiply by 2. 



values = 2*feval(f , arguments) ; 



Yoin the formula all midpoint values are multiplied by 4 



midpoint Values = 4*feval(f .midpoint Args) ; 



y.since we have calculated the value of the endpoints twice we need to 
y.subtract the values and we need to multiply by (l/6)*delta = l/6*(b-a)/n 



thesum = (l/6)*delta*(sum(midpointValues)+sum(values)-f eval(f ,a)-f eval(f ,b) ) ; 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0^ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 



f ormat long 



f = inline ( '4 ./ (1+ x."2)','x'); '/> must be vectorized for third versions! 
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a = 0; 
b = 1; 

CI = 12; 
C2 = 96; 

^1 ^1^1 til til til til til 
/o /o /o /o /o /o /o /o 

n=10000; 

tic, A = TrapezoidalRuleKf ,a,b,n) ; toe /Celapsed.time = 9.210232 

tic, A = TrapezoidalRule2(f ,0, 1 ,n) ; toe y,elapsed_time = 4.533945 

tic, A = TrapezoidalRule3(f ,0,l,ii) ; toe '/.elapsed.time = 0.009738 !!!!! 
A 

ErrT = Cl*(b-a) "2/(12 * n"2) 
Error = abs(A-pi) 

tic, A = SimpsonsRulel (f ,a,b,n) ; toe 
tic, A = SimpsonsRule2(f ,a,b,n) ; toe 
tic, A = SimpsonsRule3(f ,a,b,n) ; toe 
A 
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ErrT = Cl*(b-a) '"2/(12 * n'-2) 
Error = abs(A-pi) 

0/0/0/0/0/ 

/o/o/o/o/o 

n = 3; 

tic, A = SimpsonsRulel (f ,a,b,n) ; toe %elapsed_time = 0.005829 

tic, A = SimpsonsRule2(f ,a,b,n) ; toe %elapsed_time = 0.004387 

tic, A = SimpsonsRule3(f ,a,b,n) ; toe "/oelapsed.time = 0.002445n 

A 

ErrS = C2*(b-a)"4/(90 * n"4) 
Error = abs(A-pi) 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

1 

%%% Let's check how the errors vary as a function 

"/o/o/o of the number n of subdivisions. 

%%% First Trapezoidal: 

y. 

n = 5; 

A = TrapezoidalRulel (f ,a,b,n) ; 

Error5 = abs(A-pi) % 0.00666653977880 

n=10; 

A = TrapezoidalRulel (f , a, b,n) ; 



145 



Math 32a Fall 2003 



R. Palais 



ErrorlO = abs(A-pi) 



0.00166666468263 



y, 

y. Since Trapezoidal is a quadratic method, the ratio 
y, of Errors to Error 10 should be about (10/5) '"2 = 4 

y. 

ratio = Error5/Errorl0 7. 3.99992862887449 

% 

'/X'/X Now Simpson's 

y, 

n = 5; 

A = SimpsonsRulel (f ,a,b,n) ; 

Errors = abs(A-pi) % 3.965057793209326e-08 

n=10; 

A = SimpsonsRulel (f , a, b,n) ; 

ErrorlO = abs(A-pi) % 6.200080449048073e-10 

y. 

y Since SimpsonsRulel is a fourth order method, the ratio 
y. of Errors to Error 10 should be about (10/5) ~4 = 16 
y. BUT, IN FACT: 

ratio = Error5/Errorl0 7. 63.95171523650308 ~ (10/5) "6 

y. 

n = 20; 

A = SimpsonsRulel (f , a, b,n) ; 

Error20 = abs(A-pi) % 9 . 687362023669266e-12 



y, 

ratio = Errorl0/Error20 % 64.00174200055011 ~ (20/10) '"6 



% So, the conclusion seems nearly inescapable that for 
% the present function, Simpson's is behaving as a 
% sixth order method ! ! ! ! 



% Shootout: Comparison of Nick Dufresne's vectorized Trapezoidal and 
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% Simpson's with non-vectorized versions. 

f = inlineC '4 . x. "2) ' , 'x' ) ; % must be vectorized for third versions! 

a = 0; 

b = 1; 

n= 100000; 

tic, A = TrapezoidalRule3(f ,a,b,n) ; toe 
Error = abs(A-pi) 
n=14; 

tic, A = SimpsonsRule3(f ,a,b,n) ; toe 
Error = abs(A-pi) 
n = 100000; 

tic, A = TrapezoidalRule2(f ,a,b,n) ; toe 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% Math 32a Fall 2003 Richard Palais Brandeis Univ. 
% Topic for Today: Programming with M-Files. 

y. 

% 1) Review of Script M-Files 

°/o 2) Review of Function M-Files 

y, 3) More Advanced Features of Function M-Files 
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y. elapsed.time = 0.07617 

y, 1.664046678229170e-ll 

y, elapsed_time = 0.002523 

y. 8.234657400407741e-ll 

% elapsed_time = 49.330224 
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% Variable number of input and output pareimeters (nargin and nargout) 

% Global Variables Workspaces and their Relation to each other 

y. Sub-functions 

% Functions as parameters (using feval) 

% Introduction to De-bugging 

t 



I3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3II3^ 
Ifllfllfllfllfllfllfllflltlltlltlltlltlltlltlhlzhhlzlfllzltin 

"L- Script M-Files (review) 

% -They are just a shorthand way to enter commands 
% - should be a list of commands (and comments) 
% - Variables introduced in a script file continue 
% to live in the Matlab basic Workspace after the 
% script finishes executing 

y. 

% - Example of a script M-file (IterateCosScript .m ) 

y. 

t=0; 
for i = 1:N 
t = cos(t) ; 
end 
t 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/oA 

% - Function M-Files (review) 

% - must begin with the keyword function, 

% - followed by the list of output variables and an = (if there are any output 

variables) 



% - followed by the ncime of the function (which must be the same as the ncime 
% of the M-file without the .m) , 

% - followed by list of input arguments (in pcirentheses) , 
% - followed by the list of commands to be executed. 

% - So here is the general schema for a function M-File with the name FcnName.m, 
% output variable x, y, . . . , and input variables a,b,... 

y. 
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% function [x,y,...] = FcnNaine(a,b, . . . ) 

% <cominand> 
% <cominand> 
% ... 

% 

y, EXAMPLE: filename PolarToRect .m 
function [x,y] = PolarToRect (r,theta) 

% This function takes two real input parameters, r and theta, that 
% represent the polar coordinates of a point on the plcine, and 
% returns two real output parameters, x and y, representing the 
% cartesian coordinates of the same point . 

X = r*cos (theta) ; 

y = r*sin(theta) ; 

y. 
y. 

y, - Variables introduced in function M-files are "local" to the function that 

is 

% they are not part of the basic Workspace, but rather they belong to a 
special 

"L Workspace belonging to the M-File, and they disappear after the script 
finishes 

"L executing. Workspaces, and their inter-relations are discussed in more 
detail 

"k below. 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

y. 

%- More Advanced Features of Function M-Files 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o /o 

y, 

% Variable number of input cind output parameters (nargin and nargout) 

y. 

%- The variable nargin: It is possible to define a Matlab functions that 

"L take a variable number of input arguments. When the user calls the function 
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% with a particular number of arguments, say n, then a standard Matlab variable 

% called nargin (for "number of arguments in" gets the value n which then 
can 

% be used in the program code to do different things depending on n. Here 
is the 

Z way it works in a rather artificial example. Suppose we want to be able 
to add 

% a variable number of arguments, say up to four. We create a file MyAdd.m 

containing 

% the following: 
1 

function theSum = MyAdd(x,y,z,w) 
if nargin == 

theSum = 0; 
elseif nargin == 1 

theSum = x ; 
elseif nargin == 2; 

theSum = x + y 
elseif nargin == 3 ; 

theSum = x + y + z ; 
elseif nargin == 4; 

theSum =x+y+z+w ; 

end 
theSum 

- There is a similar variable nargout that gives the number of output variables 

actually 

% used in a given call of a function with several output parameters . 

1 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% - Global Variables Workspaces and their Relation to each other 

I 

% A Matlab program that does something reasonably complex will often use 
% many different functions that are either built in Matlab functions or 
% else user defined functions defined in some M-File. It is important to 
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% be able to communicate information (e.g., the current values of variables) 

% between these functions. Now remember that each M-File has its own private 

% Workspace which is different from the base Workspaceof the command window. 

% Suppose you declare a variable named X in the command window and also declare 

% variables named X in two different function M-Files . If you now call these 

y, functions in the command window, or if you call one of these functions 
from 

% the other, then the different variables named X are unrelated, and changing 

% the value of one of them does not effect the others . So how can you communicate 

y, information back and forth between M-Files and the command window. You 
can 

% probably guess the answer the best way to do this is to use the input 

and 

% output variables of the functions as we have been doing. However, this 

is 

% sometime inconvenient and Mat lab does have anothr mechanism (which should 

% be used sparingly) and this is the so-called global Workspace . You can 
declare 

% a variable, say Z to be global as follows: 
global Z 

% and then it belongs to the global Workspace . If you declare a variable 

to 

% be global in the command window and again in several M-Files, then they 

% are all the same variable, and if you change the value in any of these 
places 

% it will change it in the others. 

% NOTE: It is conventional to use all capital letters for global variables! 
% 

% Example: Create an M-file called TestGlobal.m containing the following: 
function outVar = TestGlobal(inVar) 

y This function demonstrates passing values with parameters and 
y using global variables 

outVar = inVar; 

inVar = 2; 
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X = 0; 
global Y 

Y = 0; 

y. Now in the command window, suppose we enter the following: 

y. 

a = 1; 
b = 0; 
X = 1; 
global Y 

Y = 1; 

a = TestGlobal(b) 

b 

X 

Y 

y. 

% Can you guess what the output will be? 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% - Sub-functions 

y. 

"L It is a good idea in programming to break up a complicated 

% algorithm into a sequence of smaller sub-algorithms. In Matlab, 

% this means that we will often create a function M-File by calling a 

% lot of other functions, either built in or defined in M-Files. 

% However, if you are ONLY going to use some simple function as a 

% sub-routine in defining some other "main" function, then Matlab 

% permits you to define the simple function in the Scime M-File 

% as the main function. These so-called sub-functions are defined 

y, just as if they were a normal function, except they are placed at 

% the end of the M-File in which they will be used (and cannot be used 

y, outside that file) . 

y. 
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% Example Create an M-file called Test SubFunct ion. m containing the following: 

function y = TestSubFunction(x) 

y = Double (Square (x) ) ; y, so y = 2 * x * x 

TLTLTLTL°L°L°L°L°L°/<, Sub Functions 
function y = Double (x) 
y = 2*x; 

function y = Square (x) 
y = X * x; 

y. 

0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/0/ 
10 10 U U IQ IQ IQ U 10 IQ IQ U 19 U IQ IQ 10 U 

% - Functions as Parcimeters (using feval) 

% Very frequently we want to create functions whose arguments are 

°/o other functions integration is a typical example, as are its 

"h approximating quadrature rules. Usually we will want to substitute 

"h for such a function argument a function that is either defined in an 

y, M-File or is a "built-in" function like sin. Matlab has a function 

% called feval to make this possible. If MyFcn is the name of a function 

% of n vciriables, then fevaK 'MyFcn' ,al ,a2, ... ,an) is the same as 

y, MyFcn(al ,a2, . . . ,an) . Here is an example of how this gets used. 

% Suppose we want to define a Matlab function called Trapezoidal with 

% parameters a function f , and two real numbers a, and b, that we want 

% to return the trapezoidal estimate of the integral of f from a to b, 

% namely 0.5*(f(a) + f(b)). In Matlab version 5 and earlier it is NOT 

% possible to have a function as the parameter of a Matlab function 

% BUT it is possible to have a string as a pareimeter, so we define 

y. Trapezoidal in a Matlab M-file called Trapezoidal .m as follows: 

y. 
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function A = TrapezoidaKf ,a,b) 

A = 0.5*(b-a)*(feval(f ,a) + feval(f,b)); 

I 

% Notice that this assumes that the pareimeter f is a string that will 
% hold the NAME of some function. 

"k Now suppose that in an M-File afcn.m we define a function afcn 

"L as follows: 

7. 

function z = afcn(x) 
z = x"2 + 2*x + 4; 

7o Then to estimate the integral of afcn from to 1 and put the result 

7o in a variable z, we would use the function call: 

7. 

z = Trapezoidal ( 'afcn' ,0, 1) ; 

7. 

7o Note carefully the quotes around afcn. 

7o The same thing works for a built-in function like sin 

7, 

z = Trapezoidal (' sin' ,0, 1) ; 
% 

7o We can also use Trapezoidal on a function F defined using inline, 
y. For example if we define the sajne unction as above using inline 
% and call it afcni: 
7, 

afcni = inline('x~2 + 2*x + 4', 'x') 

7. 

7o then the Trapezoidal approximation to the integral is given by 
7. 

z = Trapezoidal (afcni, 0,1) ; 

7. 

7. THAT'S RIGHT without the quotes! That is because the inline 

7o function actually returns a string. In fact we can do the above 

7, evaluation more simply in one step, without defining MyFcnl as follows: 
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y. 

z = Trapezoidal (inline ('x'"2 + 2*x + 4', 'x'),0,l); 

I 

% Of course this is NOT very elegant it is both inconsistent and 

% non-intuitive and so leads to lots of programming errors. In the 

"k most recent version of Matlab (version 6) this problem has been 

°/o fixed. It now IS possible to have as a parameter of a Matlab 

"k function another Matlab function (rather than the string that is 

y„ its name, so in Matlab version 6 we could define the Trapezoidal 

% function by 

% 

function A = TrapezoidaKf ,a,b) 

A = 0.5*(b-a)*(f (a) + f(b)); 

y. 

% avoiding the use of feval. Then we would call it consistently 
y. as 

y, 

z = Trapezoidal (af cn,0, 1) ; 
% or 

y. 

z = Trapezoidal (sin, 0, 1) ; 

y. 

y, or 

y, 

z = Trapezoidal (inlineCx" 2 + 2*x + 4', 'x'),0,l); 

y. 

% However for this course, I would pefer for you to 
% stick with the Matlab version 5 conventions. 

liiliililiihiiihhU/iihiiih/iihIihhhiiihh 

% - Introduction to De-bugging 

y. 
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% No matter how experience you become or how careful 

% you are, you will always make errors, i.e., bugs 

% are a fact of programming life, and you will have 

% to learn to live with that fact. That does not mean 

% that you have to live with the bugs it means that 

"L you must learn how to test for them and how to 

% eliminate them when you find them. This is a very 

% big topic and we can only scratch the surface here. 
t 

% There is one basic, time-tested strategy for debugging, 

% which is to stop the program at various points (so-called) 

% breeikpoints) and then test the values of variables to 

% see if they have the values you expect them to. In Matlab 

% if you put the word "keyboard" into an M-File, then any 

% time the programm reaches that point, the program stops 

% running and you can type various commands to check the 

% values of variables (or change them) . To restart the execution 

7o of the M-File, type the six letters "RETURN" and then 

% the return key 

% 
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°/o A Short Introduction to Movie Making in Matlab 

°/o Lacra Bintu 



"h Matlab stores movies as information in matrices. 

"h The information for each frame is stored as to one column in the movie matrix. 

% Somewhere near the beginning of your file you must initialize your movie 
matrix . 

y. Suppose you want to name your movie MyFilm, and you want it to have N frames. 

N=100; y say how many frames you want 

MyFilm=moviein(N) ; % initialize the movie matrix; 

for i=l:N 

x=cos(2*pi*i/N) ; y=sin(2*pi*i/N) ; % The simplest example I could 
think of : 

% a point moving in a circle 

f igure(l) 
plot(x,y, 'o') 

axis ([-1.5 1.5 -1.5 1.5]) % fixing the axis, so that they 

will 

% be the same for all frames 

y, axis([XMIN XMAX YMIN YMAX] ) 

MyFilmC : ,i)=getframe; % takes the information from the 

current picture 

% and puts it in the ith column 

of the movie matrix 

% (this will be the ith frame of MyFilm) 

end % It ' s a wrap ! That ' s all there 

is to it. 

movie (MyFilm) % Plays Myfilm 

% Say you weint to save the movie 
% in a file called MyBest (you don't need 

to) : 



157 



Math 32a Fall 2003 



R. Palais 



Save MyFilm MyBest 



load MyBest 
in the movie file 

Movie (MyFilm) 
been stored in 



y. To play the saved movie : 

°/o This loads the information stored 

% This plays the movie that had 

°/o MyBest (meaning the movie MyFilm) 



% So to recapitulate : 



% <Moviename> = moviein(<number of frames>) ; 
movie matrix 

% <Moviename> ( : , i) 
figure in 

matrix . 

% Save <Moviencime> <Filename> 
data file 

"h load <Filename> 
in <Filenaine> 

% Movie <Moviename> 
animation 



% moviein initializes the 



% saves contents of current 



% i-th column of the movie 



% Saves movie matrix in a 



% Reads movie data stored 



% Plays <Moviename> as an 



0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ tt/ V V V V V V V W W W W V V V V V V V V V V V V V V 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 



Sometimes, when you are drawing more than one object 
% in each frame you might want to use hold on and hold off . 
y. If you put hold on after plotting the first object, 
% when you plot another object (in the Scime frame) 
% the first object does not disappear from view. 
y„ If you put hold off after the second plot, the next 
% plot after that will cover everything already in your figure. 
% Below is a quick exeimple, using the same code as before, 
% but now making use of hold on and hold off . 
°h (If you didn't understand what I just said above about hold 
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% on and hold off, just try experimenting 

y, with the code below, by deleting first 

% hold off and then hold on eind see what happens . 

% That should make it it clear . ) 

N=100; MyFilm=movieiii(N) ; 
for i=l:N 

x=cos(2*pi*i/N) ; y=sin(2*pi*i/N) ; 

figure (1) 

plot(x,y, 'o') 

hold on 

xl=[0 x] ; yl=[0 y] ; 

plot(xl,yl) "/.draws the radius of the circle 

hold off 

axis([-1.5 1.5 -1.5 1.5]) 
MyFilm(: ,i)=getframe; 
end 

movie (MyFilm) 

y„ If you use an earlier version of Matlab, 
"L you can turn your movie into an avi file 
% using movie2avi. 

0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 0/ 

/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/o/ort 

% Here is a more sophisticated and interesting example. 
% It is the contents of a script M-File called ellipse. m 

% This file creates and plays a movie showing the osculating circles to an 
ellipse 

% Lacra Bintu 
clear all 
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close all 

n=100; % the number of freimes 

Mellipse=moviein(n) ; % initializing the matrix that will contain the information 
for the movie 

a=1.6; % the value of the big axis of the ellipse 

b=0.9; % the value of the big axis of the ellipse 

t=[0:2*pi/n:2*pi] ; % setting the values of t where we want to see the circles 

x=a*cos(t); % finding the x coordinate from the parametric equation 
of an ellipse 

y=b*sin(t) ; % finding the y coordinate from the parametric equation 
of an ellipse 

k=a*b./(a'"2.*sin(t) .'■2+b'"2*cos(t) .'"2) .'■(3/2) ; % the curvature of the ellipse 
at the chosen t values 

r=l./k; °/o the radii of the osculating circles at each chosen 
value of t 



xo=x-b*r.*cos(t) ./((b"2)*cos(t) .'■2+a'"2*sin(t) .'"2) .'■(1/2) ; % the x cordinate 
of the centers of the circles 

yo=y-a*r.*sin(t) ./((b"2)*cos(t) .'■2+a'"2*sin(t) ."2) ."(1/2) ; % the y cordinate 
of the centers of the circles 



m=2*max(r) -min( [a,b] ) ; % calculating about how big we want the axes of our 
figures to be 

for i=l:n+l 

xc=xo(i)+r(i)*cos(t) ; % finding all the x coordinates necessary to draw the 
osculating 

% circle at the point i*2pi/n 

yc=yo(i)+r(i)*sin(t) ; % finding all the x coordinates necessary to draw the 
osculating 

% circle at the point i*2pi/n 
figured) 

plot(x,y, 'k') % draw the ellipse 
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hold on % keep the figure from being erased 

plot (xc,yc, 'r' ) % draw the osculating circle at at the point i*2pi/n 

plot (xo(l : i) ,yo(l : i) ) % draw all the centers of the circles up to that 
point 

plot ( [xo(i) ,x(i)] , [yo(i) ,y(i)] , 'r — ') % draw the normal to the ellipse 
hold off y, allow the figure to be erased 

axis([-m m -mm]) % set the axis to some appropriate value 

Mellipse ( : , i)=getf rame ; % put the information from the resulting figure 
% as a column in the movie matrix 

end 

movie (Mellipse) % play the movie 
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